Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request]: batch loading documents so OpenAI doesn't throttle #1611

Open
weiligu opened this issue Jan 3, 2024 · 0 comments
Open

[Feature Request]: batch loading documents so OpenAI doesn't throttle #1611

weiligu opened this issue Jan 3, 2024 · 0 comments
Assignees
@atroyn
Labels
enhancement New feature or request

Comments

@weiligu
Copy link
Contributor

weiligu commented Jan 3, 2024

Describe the problem

getting throttled by OpenAI using their embedding model when trying to add many documents to collections

Describe the proposed solution

batch requests to slow down and retry if throttled

Alternatives considered

No response

Importance

would make my life easier

Additional Information

#1110
@weiligu weiligu added the enhancement New feature or request label Jan 3, 2024
@atroyn atroyn self-assigned this May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@atroyn atroyn

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@atroyn @weiligu