Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remote: Limit max number of gRPC connections by --remote_max_connections. #14202

Closed

Conversation

coeuvre
Copy link
Member

@coeuvre coeuvre commented Nov 1, 2021

--remote_max_connections is only applied to HTTP remote cache. This PR makes it apply to gRPC cache/executor as well.

Note that --remote_max_connections limits the number of concurrent connections. For HTTP remote cache, one connection could handle one request at one time. For gRPC remote cache/executor, one connection could handle 100+ concurrent requests. So the default value 100 means we could make up to 100 concurrent requests for HTTP remote cache or 10000+ concurrent requests for gRPC remote cache/executor.

Fixes: #14178.

@coeuvre coeuvre requested a review from a team as a code owner November 1, 2021 04:16
@google-cla google-cla bot added the cla: yes label Nov 1, 2021
@brentleyjones
Copy link
Contributor

Btw, this would be nice to get into the 5.0 RC if possible.

@coeuvre
Copy link
Member Author

coeuvre commented Nov 2, 2021

Btw, this would be nice to get into the 5.0 RC if possible.

Sure, I can get this into 5.0.

@coeuvre coeuvre added this to the Bazel 5.0 Release Blockers milestone Nov 4, 2021
@Wyverald
Copy link
Member

What's the status of this?

@coeuvre
Copy link
Member Author

coeuvre commented Nov 16, 2021

The PR is ready. I will import and send out for review.

@bazel-io bazel-io closed this in 063b5c9 Nov 16, 2021
@Wyverald Wyverald removed this from the Bazel 5.0 Release Blockers milestone Nov 16, 2021
Wyverald pushed a commit that referenced this pull request Nov 16, 2021
…ons.

`--remote_max_connections` is only applied to HTTP remote cache. This PR makes it apply to gRPC cache/executor as well.

Note that `--remote_max_connections` limits the number of concurrent connections. For HTTP remote cache, one connection could handle one request at one time. For gRPC remote cache/executor, one connection could handle 100+ concurrent requests. So the default value `100` means we could make up to `100` concurrent requests for HTTP remote cache or `10000+` concurrent requests for gRPC remote cache/executor.

Fixes: #14178.

Closes #14202.

PiperOrigin-RevId: 410249542
limdor pushed a commit to limdor/bazel that referenced this pull request Nov 24, 2021
…ons.

`--remote_max_connections` is only applied to HTTP remote cache. This PR makes it apply to gRPC cache/executor as well.

Note that `--remote_max_connections` limits the number of concurrent connections. For HTTP remote cache, one connection could handle one request at one time. For gRPC remote cache/executor, one connection could handle 100+ concurrent requests. So the default value `100` means we could make up to `100` concurrent requests for HTTP remote cache or `10000+` concurrent requests for gRPC remote cache/executor.

Fixes: bazelbuild#14178.

Closes bazelbuild#14202.

PiperOrigin-RevId: 410249542
(cherry picked from commit 8d5973d)
meteorcloudy pushed a commit that referenced this pull request Nov 24, 2021
…ons. (#14318)

`--remote_max_connections` is only applied to HTTP remote cache. This PR makes it apply to gRPC cache/executor as well.

Note that `--remote_max_connections` limits the number of concurrent connections. For HTTP remote cache, one connection could handle one request at one time. For gRPC remote cache/executor, one connection could handle 100+ concurrent requests. So the default value `100` means we could make up to `100` concurrent requests for HTTP remote cache or `10000+` concurrent requests for gRPC remote cache/executor.

Fixes: #14178.

Closes #14202.

PiperOrigin-RevId: 410249542
(cherry picked from commit 8d5973d)

Co-authored-by: Chi Wang <chiwang@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Bazel 4.2.1 doesn't respect --remote_max_connections
3 participants