Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

openai问题 #5194

Open
shilv520 opened this issue Jan 16, 2025 · 1 comment
Open

openai问题 #5194

shilv520 opened this issue Jan 16, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@shilv520
Copy link

An error occurred during streaming

INFO: 127.0.0.1:57108 - "POST /chat/chat/completions HTTP/1.1" 200 OK
2025-01-16 17:26:43,528 httpx 3854 INFO HTTP Request: POST http://127.0.0.1:7861/chat/chat/completions "HTTP/1.1 200 OK"
2025-01-16 17:26:43,536 httpx 3812 INFO HTTP Request: POST http://127.0.0.1:9997/v1/chat/completions "HTTP/1.1 200 OK"
2025-01-16 17:26:43.547 | ERROR | chatchat.server.api_server.openai_routes:generator:105 - openai request error: An error occurred during streaming
这个怎么解决啊,可以不调用openai吗

@shilv520 shilv520 added the bug Something isn't working label Jan 16, 2025
Copy link

dosubot bot commented Jan 16, 2025

Hey @shilv520, I'm here to help you with your coding conundrums! Let's squash those bugs and unravel the mysteries of code together. 🤖

A similar issue has been discussed in an open thread where enabling detailed logging was suggested as a way to diagnose the problem further. You can enable verbose logging by using the chatchat-config command with the --verbose option set to true:

chatchat-config basic --verbose true

Additionally, check the logs for any errors reported by xinference, as they might provide more insights into the issue [1].

Regarding your question about not calling the OpenAI API, Langchain-Chatchat can use local models as an alternative to the OpenAI API for generating completions. It supports various local model deployment frameworks like Xinference, Ollama, LocalAI, and FastChat, which allow you to run models locally without relying on external APIs [2][3].

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant