Model loading problem with Ollama

[RaemyS]

Hi there,

I am using openui out of pinokio (https://pinokio.computer/item?uri=https://github.com/pinokiofactory/openui).
As a LLM backend, i'm using Ollama in its current version 0.4.6.

If i want to try your tool, i get the error message "Error! 404 Error code: 404 - {'error': {'message': 'model "undefined" not found, try pulling it first', 'type': 'api_error', 'param': None, 'code': None}}" after sending a prompt.

As i try to set a different model, i noticed in the settings window, that the select box does not show any model names but only empty entries:

It does not matter, which of those entries i choose, the error persists.

If i quit Ollama and try to resolve the installed models, the seleciton is empty:

So the model resolution from Ollama seems to work at least partially (6 entries are correct, according to the 6 currently installed models).
My guess is, that openui is not able to resolve the information from the Ollama model list request correctly and further on, this leads to the upper error message.

Do you have any ideas, to solve this problem?

Thx :)

[hashemAlsaggaf]

Same exact issue here. pre-existing Ollama install.

[alexandregodard]

Hello,
Miss the name property inside the json returned by the lib ollama in python.
Even if the ollama endpoint http://localhost:11434/api/tags return
.
the endpoint on his side remove it http://127.0.0.1:7878/v1/models
.

Inside the frontend it is used in several places :

• frontend/src/components/Settings.tsx:109-232-233

It can be fixed by updating the frontend Settings.tsx.
A q&d solution is to update the object provided by the backend in server.py (function get_ollama_models)

a PR has been created for the settings

[RaemyS]

Nice, thanks for the fix @alexandregodard .
Unfortunately, i'm not skilled enough with the current tech stack, so i'm not able to compile and test the changes locally without further research.

Hope your fix finds its way to the app soon, so i can update the tool and try again :)

[Fox-Me]

Please, how to solve it. I'm having the same issue with ollama: