Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setting up new model packs doesn't ask for base uri #183

Open
viraptor opened this issue Aug 14, 2024 · 2 comments
Open

Setting up new model packs doesn't ask for base uri #183

viraptor opened this issue Aug 14, 2024 · 2 comments
Assignees

Comments

@viraptor
Copy link

I've tried adding deepseek coder to the model pack. When using the openai provider, I get asked for the key variable, but not the base url.
Ideally, I'd get asked about it with the default being the actual openai upstream.

@danenania
Copy link
Contributor

What provider are you using for deepseek coder? The openai provider is mainly intended to be used for the official OpenAI api, though you do have the OPENAI_API_BASE environment variable that allows you to point elsewhere.

@viraptor
Copy link
Author

I used the openai provider, some deepseek has a compatible API. Deepseek coder works ok there with function calling off.
I ended up editing the base URI in the settings file instead, which made me realise it's the only parameter that the CLI didn't ask me for.

@danenania danenania self-assigned this Sep 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants