fixbug: there's a problem about using external LLM of huoshan #1429 #1438
Conversation
|
Codecov ReportAttention: Patch coverage is
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. Additional details and impacted files@@ Coverage Diff @@
## main #1438 +/- ##
==========================================
- Coverage 62.62% 62.58% -0.04%
==========================================
Files 287 287
Lines 17564 17588 +24
==========================================
+ Hits 10999 11008 +9
- Misses 6565 6580 +15 ☔ View full report in Codecov by Sentry. |
iorisa
changed the title
iorisa
changed the title
| @@ -16,11 +37,45 @@ class ArkLLM(OpenAILLM): | |||
| 见：https://www.volcengine.com/docs/82379/1263482 | |||
| """ | |||
|
|
|||
| aclient: Optional[AsyncArk] = None | |||
There was a problem hiding this comment.
Seems ark has a openai compatible interface, should we use the official sdk?
There was a problem hiding this comment.
ok, to support also ak/sk
There was a problem hiding this comment.
The openai compatible interface is not working, so it's replaced by sdk.
| @@ -187,6 +187,14 @@ | |||
| "mixtral-8x7b": {"prompt": 0.4, "completion": 1.6}, | |||
| } | |||
|
|
|||
| # https://console.volcengine.com/ark/region:ark+cn-beijing/model | |||
| DOUBAO_TOKEN_COSTS = { | |||
There was a problem hiding this comment.
There also doubao-xx related token cost under TOKEN_COSTS, you can delete it.
There was a problem hiding this comment.
The model name has the version number embedded in it.
DOUBAO_TOKEN_COSTS provides model names without version numbers for pricing_plan configuration.
|
lgtm |
Features