Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Missing the [include_reasoning] content, but I only get the <think> in content(not stream) #8267

Open
gumutianqi opened this issue Feb 5, 2025 · 5 comments · May be fixed by #8288
Open
Labels
bug Something isn't working

Comments

@gumutianqi
Copy link

What happened?

Image

Relevant log output

Look at the response body. there is missing the include_reasoning, I got the reason content in `<think>`,so how can I hold it?

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.60.2

Twitter / LinkedIn details

No response

@gumutianqi gumutianqi added the bug Something isn't working label Feb 5, 2025
@krrishdholakia
Copy link
Contributor

Hi @gumutianqi this seems like azure ai didn't parse the output correctly - we can add handling for this

@krrishdholakia
Copy link
Contributor

cc: @vibhavbhat

from httpx import Response

@vibhavbhat
Copy link
Contributor

@krrishdholakia I can work on this

@gumutianqi
Copy link
Author

@vibhavbhat How to make it work? which version? and can you show me the request body deatils. Thank you.

@vibhavbhat vibhavbhat linked a pull request Feb 5, 2025 that will close this issue
@vibhavbhat
Copy link
Contributor

@gumutianqi I made the fix for this in #8288. After it is merged, the reasoning_content will be correctly populated

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants