You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Adding Deepseek-R1 deployed on volcengine, volcengine has supported the r1 model, but there is no reasoning_content in the r1 response parameters, can you add it?
I am trying to access the Deepseek-R1 model through volcengine, and I can get the response result, but I found that "reasoning_content" parameters are missing in the response result, and I hope to adapt it
The Feature
Adding Deepseek-R1 deployed on volcengine, volcengine has supported the r1 model, but there is no reasoning_content in the r1 response parameters, can you add it?
https://docs.litellm.ai/docs/providers/volcano
Motivation, pitch
I am trying to access the Deepseek-R1 model through volcengine, and I can get the response result, but I found that "reasoning_content" parameters are missing in the response result, and I hope to adapt it
Inference content for the expected response body:
{
"choices": [
{
"finish_reason": "stop",
"index": 0,
"logprobs": null,
"message": {
"content": ".....",
"reasoning_content": ".....",
"role": "assistant"
}
}
],
"created": 1738752116,
"id": "0217387520712960fa2ee87f2976183a0d77cb9bf7fa6a37fcac1",
"model": "deepseek-r1-250120",
"object": "chat.completion",
"usage": {
"completion_tokens": 599,
"prompt_tokens": 30,
"total_tokens": 629,
"prompt_tokens_details": {
"cached_tokens": 0
},
"completion_tokens_details": {
"reasoning_tokens": 290
}
}
}
Are you a ML Ops Team?
No
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered: