Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hugging Face 的链接好像失效了 #37

Open
thunderbolt-fire opened this issue Dec 10, 2024 · 3 comments
Open

Hugging Face 的链接好像失效了 #37

thunderbolt-fire opened this issue Dec 10, 2024 · 3 comments

Comments

@thunderbolt-fire
Copy link

image
能否更新一下

@tcy6
Copy link
Collaborator

tcy6 commented Dec 10, 2024

@thunderbolt-fire 你好,感谢提醒,经过我们检查发现这是因为订阅的Pro已到期,我们正准备向HuggingFace官方提交申请,demo预计这几日之内恢复。

@thunderbolt-fire
Copy link
Author

@thunderbolt-fire 你好,感谢提醒,经过我们检查发现这是因为订阅的Pro已到期,我们正准备向HuggingFace官方提交申请,demo预计这几日之内恢复。

image
谢谢,还想请问一下需要多大的显卡才能完整运行pipline里的内容,我在本地使用4060Ti,8G显存,好像无法运行。
image
应该是显存不足,无法加载模型

@tcy6
Copy link
Collaborator

tcy6 commented Dec 11, 2024

@thunderbolt-fire 你好,感谢提醒,经过我们检查发现这是因为订阅的Pro已到期,我们正准备向HuggingFace官方提交申请,demo预计这几日之内恢复。

image 谢谢,还想请问一下需要多大的显卡才能完整运行pipline里的内容,我在本地使用4060Ti,8G显存,好像无法运行。 image 应该是显存不足,无法加载模型

VisRAG-Ret参数量为3.43B,MiniCPM-V-2_6参数量为8.1B,因此模型权重大约需要23GB (bf16) 显存,考虑其他占用的话,预计需要40GB及以上的显存~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants