-
Notifications
You must be signed in to change notification settings - Fork 69
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow creating and launching an OpenWebUI container via Dev UI #600
Conversation
There is an issue with the volume handling. It does not appear if you've created the container manually, but will hit users that never used open-webui before and just tried to created from devui. Converting to draft till I solve this one. |
@iocanel is this ready or still in draft? |
This is ready |
.../runtime/src/main/java/io/quarkiverse/langchain4j/runtime/devui/OpenWebUIJsonRPCService.java
Show resolved
Hide resolved
.../runtime/src/main/java/io/quarkiverse/langchain4j/runtime/devui/OpenWebUIJsonRPCService.java
Outdated
Show resolved
Hide resolved
IIUC this just connects to the remote model provider directly by itself, so we can't have it working with our RAG mechanisms etc, right? Or could we make it work by perhaps, exposing the Ollama/OpenAI API by Quarkus as some kind of wrapper that adds our RAG and applies our configuration and having the OpenWebUI call the remote model through that? |
Your understanding is correct, it just runs an Open WebUI instance that is aligned with the app in terms of model. |
Should we merge this or are we waiting for some changes? |
Updated PR:
|
For anyone trying it with ollama running locally don't forget to set OLLAMA_HOST=0.0.0.0 otherwise ollama won't be visible from the container. |
I just built this locally but I don't see anything new the DevUI so I guess I am missing something :) |
@iocanel any idea about ^? |
The only thing I can think of is that either you sample is not using ollama, openai or its not using a SNAPSHOT. Let me try it again. |
After rebasing, I can no longer see anything myself |
So it's not just me :) |
This comment was marked as duplicate.
This comment was marked as duplicate.
Yeah, the PR needed alignment with the new module structure. Fixed now. |
I just tried it and it woks nicely! The UI could certainly be improved, but I think we should merge now and improve later |
cc @jmartisk |
Resolves: #581
The pull request introduces the following: