Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remote: Only waits for background tasks from remote execution. #14634

Closed
wants to merge 1 commit into from

Conversation

coeuvre
Copy link
Member

@coeuvre coeuvre commented Jan 24, 2022

We added the block waiting behaviour after each command in remote module to wait for background uploads when introducing async upload. However, not all background uploads should be waited, e.g. uploads from BES module but with flag --bes_upload_mode=fully_async.

This PR updates remote module so that only uploads initiated by remote module are waited after the command. This also enable us to implement something like --remote_upload_mode=fully_async in the future.

Fixes #14620.

@coeuvre coeuvre requested a review from meisterT January 24, 2022 20:29
@coeuvre coeuvre requested a review from a team as a code owner January 24, 2022 20:29
@brentleyjones
Copy link
Contributor

brentleyjones commented Jan 24, 2022

This also enable us to implement something like --remote_upload_mode=fully_async in the future.

❤️

@brentleyjones
Copy link
Contributor

@Wyverald This fixes a 5.0 regression. Can we add it to the 5.0.1 milestone?

@bazel-io bazel-io closed this in 3836ad0 Jan 26, 2022
@Wyverald
Copy link
Member

Wyverald commented Feb 1, 2022

(for the record, the linked issue is tracked on the 5.1 milestone)

brentleyjones pushed a commit to brentleyjones/bazel that referenced this pull request Feb 8, 2022
We added the block waiting behaviour after each command in remote module to wait for background uploads when introducing async upload. However, not all background uploads should be waited, e.g. uploads from BES module but with flag `--bes_upload_mode=fully_async`.

This PR updates remote module so that only uploads initiated by remote module are waited after the command. This also enable us to implement something like `--remote_upload_mode=fully_async` in the future.

Fixes bazelbuild#14620.

Closes bazelbuild#14634.

PiperOrigin-RevId: 424296966
(cherry picked from commit 3836ad0)
Wyverald pushed a commit that referenced this pull request Feb 9, 2022
We added the block waiting behaviour after each command in remote module to wait for background uploads when introducing async upload. However, not all background uploads should be waited, e.g. uploads from BES module but with flag `--bes_upload_mode=fully_async`.

This PR updates remote module so that only uploads initiated by remote module are waited after the command. This also enable us to implement something like `--remote_upload_mode=fully_async` in the future.

Fixes #14620.

Closes #14634.

PiperOrigin-RevId: 424296966
(cherry picked from commit 3836ad0)

Co-authored-by: Chi Wang <chiwang@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

--bes_upload_mode=fully_async is ignored in Bazel 5
4 participants