Skip to content

Issues: xusenlinzy/api-for-open-llm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

19 Open 268 Closed
19 Open 268 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Can I manually modify the code so that the new model can be supported?
#316 opened Dec 10, 2024 by zhanglixuan0720
2 tasks done
4*4090 显卡部署glm4-9b 使用dify 的api调用报错
#315 opened Oct 14, 2024 by he498
2 tasks done
1
框架vllm输出截断，但是官方vllm启动和transformers运行模型都不
#314 opened Sep 28, 2024 by TLL1213
2 tasks done
2
运行glm4v请求报错
#311 opened Sep 4, 2024 by 760485464
2 tasks done
2
not support sglang backend
#309 opened Aug 30, 2024 by colinsongf
2 tasks done
TASKS=llm,rag模式下，出现线程问题报错：RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method
#308 opened Aug 21, 2024 by syusama
2 tasks done
3
部署gte-qwen2-1.5b-instruct请求rerank接口报错
#307 opened Aug 20, 2024 by cowcomic
2 tasks done
💡 [REQUEST] - 请问可以支持中国电信大模型Telechat吗？流程可以跑通，但是回复content会被截断 question Further information is requested
#301 opened Aug 2, 2024 by Song345381185
9
llama3-8B回答后自我交流，不停止
#296 opened Jul 9, 2024 by yd9038074
2 tasks done
1
minicpm启动没问题，推理访问报错
#292 opened Jun 28, 2024 by 760485464
2 tasks done
2
glm-4v启动正常 访问推理报错
#291 opened Jun 28, 2024 by 760485464
2 tasks done
10
glm4 接入dify后无法触发使用工具
#288 opened Jun 14, 2024 by he498
2 tasks done
1
使用 streamer_v2 会造成乱码
#287 opened Jun 13, 2024 by Tendo33
2 tasks done
2
无法运行instruction.py
#280 opened Jun 5, 2024 by NCCurry30
2 tasks done
什么时候能修复 Qwen 1.5 call function功能了。 question Further information is requested
#273 opened May 11, 2024 by skyliwq
Qwen1.5不支持tool_choice enhancement New feature or request
#245 opened Mar 12, 2024 by YunmengLiu0
2 tasks done
4
docker vllm运行qwen1.5-7b-chat无法部署，报错：Fatal Python error: Bus error
#242 opened Mar 2, 2024 by syusama
2 tasks done
2
Qwen1.5推理报错RuntimeError: cannot reshape tensor of 0 elements into shape [-1, 0] because the unspecified dimension size -1 can be any value and is ambiguous
#241 opened Feb 28, 2024 by syusama
2 tasks done
6
💡 [REQUEST] - 请问如何支持 Qwen/Qwen-VL-Chat question Further information is requested
#105 opened Sep 6, 2023 by wangschang
1
ProTip! Adding no:label will show everything without a label.