-
Notifications
You must be signed in to change notification settings - Fork 588
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
support more optioin about usage in stream mode #985
support more optioin about usage in stream mode #985
Conversation
What is wrong with the default mem_fraction_static? |
I hope all finish reasons are considered as per openai api format. Every response will include a finish_reason. The possible values for finish_reason are: |
@meetzuber please stay tuned for the function_call and content filter, we will support that in the future |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please resolve the conflicts and we can merge this
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Thank you for your contribution, we really appreciate it. The following instructions will help improve your pull request and make it easier to receive feedback. If there are any items you don't understand, don't worry. Just submit the pull request and ask the maintainers for help.
Motivation
Fix #954
Modification
adapter and protocol in openai
Checklist
pre-commit run --all-files
or other linting tools are used to fix potential lint issues.