Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Oobabooga's text-generation-webui #278

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

RedBoxing
Copy link

Add support for oobabooga's text-generation-webui for scribe workers.

I wasn't sure how to implement softprompts so I didn't implement them for oobabooga's, I'm not even sure if there is an equivalent in oobabooga's.

@db0
Copy link
Member

db0 commented Jul 24, 2023

Question, instead of manually setting the is_oobabooba var, isn't there an endpoint you can check to validate what kind of API it's serving and set this variable automatically?

@RedBoxing
Copy link
Author

RedBoxing commented Jul 24, 2023

I guess we could try to make the request to get the model and if we get a 404 that would probably mean that it's not a oobabooga server because the endpoint is not the same for oobabooga and koboldai

@db0
Copy link
Member

db0 commented Jul 24, 2023

Doesn't their API have any endpoint which just tells you what software it's running?

@RedBoxing
Copy link
Author

RedBoxing commented Jul 24, 2023

I looked but didn't find anything that could help us identify the server other than checking if a specific endpoint exist

@db0
Copy link
Member

db0 commented Aug 24, 2023

OK let's do that, as it will simplify setting the worker

@Anthonyg5005 Anthonyg5005 mentioned this pull request Jan 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants