Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(multipart file uploader): using shared http client #103

Merged
merged 6 commits into from
Sep 14, 2021

Conversation

stakach
Copy link
Contributor

@stakach stakach commented Sep 14, 2021

this resolves an issue where the HTTP client was shared and the one client was making all the requests concurrently.
The built-in http client does not support this and resulted in interlaced writes, but it did sometimes succeed. The specs succeed as they never blocked the reactor and hence never actually executed in parallel.

I've also added configuration to limit the number of parallel uploads as previously it was uploading the complete file at once which could exhaust memory.

this resolves an issue where the HTTP client was shared and the one client was making all the requests concurrently.
The built-in http client does not support this and resulted in interlaced writes, but it did sometimes succeed. The specs succeed as they never blocked the reactor and hence never actually executed in parallel.

I've also added configuration to limit the number of parallel uploads as previously it was uploading the complete file at once which could exhaust memory.
@stakach
Copy link
Contributor Author

stakach commented Sep 14, 2021

all good now, just squash commits on merge :)

@taylorfinnell
Copy link
Owner

Thank you for fixing this! :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants