You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It'd be really good for customization if you would let us use newlines in the system prompt, they're a very common delimiter and forcing the prompt to be on one line makes customization somewhat limited.
Another thing that would be great to be able to customize is where the RAG context is inserted.
Really want to be able to use this UI with a client because it's very easy to setup;
Thanks for considering this!
The text was updated successfully, but these errors were encountered:
Great idea! I'll make the system prompt a textarea and a bit more UI friendly.
Every generator class has a prepare_messages method. This method is used to format the messages that are sent to the LLM. The position of the context in the messages is important because it determines where the context is placed in the conversation. You can modify the generator code to your liking, right now, there is no way to do that over the UI
Hi,
It'd be really good for customization if you would let us use newlines in the system prompt, they're a very common delimiter and forcing the prompt to be on one line makes customization somewhat limited.
Another thing that would be great to be able to customize is where the RAG context is inserted.
Really want to be able to use this UI with a client because it's very easy to setup;
Thanks for considering this!
The text was updated successfully, but these errors were encountered: