32k模型RuntimeError: probability tensor contains either inf, nan or element < 0
#891
Unanswered
guodastanson
asked this question in
Q&A
Replies: 1 comment
-
|
你正常对话能行吗，这个感觉是你出发了词表外的词 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
跑的是官方demo，gradio或者streamlit都报这个，用综合模型里面启动也是报这个。do_sample我改了basic_demo下的cli_batch_request_demo.py里的，还是没效果。
环境是centos, python 3.10, cuda是12.1，GPU两张3090
Beta Was this translation helpful? Give feedback.
All reactions