Continue feature is always shown with OpenAI

[gururise]

As shown in the image below, when using OpenAI endpoint (gpt-3.5-turbo-1106), after every inference the Continue button is shown.

When I press the continue button in the example below, chatgpt responds "I'm here to help". I pressed the button multiple times, so you can see the response and that the Continue button never goes away.

This issue does not exist when using Together.ai with their OpenAI compatible endpoint.

[nsarrazin]

Thanks for reporting this! Will take a look

[flexchar]

@gururise could you show how it looks when using Together.ai?

[gururise]

@gururise could you show how it looks when using Together.ai?

Using Mixtral on Together.ai, if asked a question, the model will respond and no Continue button will be present after the model is done responding.

[brettpappas]

Having the same issue (Azure OpenAI). Is there a way to disable the continue button until this gets fixed? I thought about hiding it using CSS but the button doesn't have an id or special class to target.

[nsarrazin]

Can you test the changes in this branch here? hopefully that should fix it, sorry for the delay with this

[brettpappas]

This fixes the issue for me on my local copy. I have not tested if it DOES show when the connection is interrupted though. I would be happy to confirm that as well if there is a way to trigger an interrupted response.

[flexchar]

This seems to be fixed for me.