Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add ollama phi4 context size defaults (#23036)
Add `phi4` maximum context length (128K). By default this clamps to `16384` but if you have enough video memory you can set it higher or connect to a non-local machine via settings: ```json "language_models": { "ollama": { "api_url": "http://localhost:11434", "available_models": [ { "name": "phi4", "display_name": "Phi4 64K", "max_tokens": 65536 } ] } } ``` Release Notes: - Improve support for Phi4 with ollama.
- Loading branch information