Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT] support groq.com #716

Closed
mikestaub opened this issue Feb 19, 2024 · 3 comments · Fixed by #794
Closed

[FEAT] support groq.com #716

mikestaub opened this issue Feb 19, 2024 · 3 comments · Fixed by #794
Labels
enhancement New feature or request

Comments

@mikestaub
Copy link

Is your feature request related to a problem? / 你想要的功能和什么问题相关?

Most models are still too slow.

Describe the solution you'd like. / 你想要的解决方案是什么?

Groq can serve 500 TPS

Describe alternatives you've considered. / 你考虑过的其他方案是什么?

No response

Additional context / 其他信息

No response

@mikestaub mikestaub added the enhancement New feature or request label Feb 19, 2024
@PeterDaveHello
Copy link
Collaborator

Let me give it a try

@PeterDaveHello
Copy link
Collaborator

I've prepared a PR and will send it once #791 is merged.

@PeterDaveHello
Copy link
Collaborator

PR sent at #794, FYR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants