We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
配置了custom engine server、custom engine token、response format,没有配置customize prompt。在LLM服务端监控autodev插件的调用情况,测试结果如下:
对照源码:CustomLLMProvider.kt。模型服务入参和返回都没有问题。
感觉插件中上述的几个功能并没有调用自定义模型地址,暂时还没有看到源码,先反馈一下,望回复,谢谢!
The text was updated successfully, but these errors were encountered:
可能是因为 CustomLLMProvider 是通过依赖注入的方式实现的,所以在实例化之后,可能就会继续使用先前的配置。这个时候关闭一下 project,再打开就好了。
auto-dev/src/main/kotlin/cc/unitmesh/devti/llms/custom/CustomLLMProvider.kt
Lines 36 to 40 in a0f16e9
Sorry, something went wrong.
我最新提交应该改了这个问题 并没有,改的是别的问题,这个要让service 使用 getter,每次都从 state 获取而不是使用第一次的
624b0bc
No branches or pull requests
配置了custom engine server、custom engine token、response format,没有配置customize prompt。在LLM服务端监控autodev插件的调用情况,测试结果如下:
对照源码:CustomLLMProvider.kt。模型服务入参和返回都没有问题。
感觉插件中上述的几个功能并没有调用自定义模型地址,暂时还没有看到源码,先反馈一下,望回复,谢谢!
The text was updated successfully, but these errors were encountered: