Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please allow newlines in the system prompt #334

Closed
e-p-armstrong opened this issue Dec 2, 2024 · 1 comment
Closed

Please allow newlines in the system prompt #334

e-p-armstrong opened this issue Dec 2, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@e-p-armstrong
Copy link

e-p-armstrong commented Dec 2, 2024

Hi,

It'd be really good for customization if you would let us use newlines in the system prompt, they're a very common delimiter and forcing the prompt to be on one line makes customization somewhat limited.

Another thing that would be great to be able to customize is where the RAG context is inserted.

Really want to be able to use this UI with a client because it's very easy to setup;

Thanks for considering this!

@e-p-armstrong e-p-armstrong added the enhancement New feature or request label Dec 2, 2024
@thomashacker
Copy link
Collaborator

Great idea! I'll make the system prompt a textarea and a bit more UI friendly.

Every generator class has a prepare_messages method. This method is used to format the messages that are sent to the LLM. The position of the context in the messages is important because it determines where the context is placed in the conversation. You can modify the generator code to your liking, right now, there is no way to do that over the UI

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants