Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deduplicate concurrent computations of the same Merkle tree. #17995

Closed
wants to merge 1 commit into from

Conversation

tjgq
Copy link
Contributor

@tjgq tjgq commented Apr 5, 2023

Currently, it's possible for concurrent actions to end up computing the same Merkle tree, even when the cache is enabled. This change makes it so that a later action waits for the completion of the computation started by an earlier action.

Progress on #17923.

@tjgq tjgq requested a review from a team as a code owner April 5, 2023 15:02
@github-actions github-actions bot added awaiting-review PR is awaiting review from an assigned reviewer team-Remote-Exec Issues and PRs for the Execution (Remote) team labels Apr 5, 2023
Currently, it's possible for concurrent actions to end up computing the same
Merkle tree, even when the cache is enabled. This change makes it so that a
later action waits for the completion of the computation started by an earlier
action.

Progress on bazelbuild#17923.
@tjgq tjgq force-pushed the merkle-singleflight branch from 584eab7 to 011bf06 Compare April 6, 2023 09:43
@tjgq
Copy link
Contributor Author

tjgq commented Apr 6, 2023

@bazel-io flag

@bazel-io bazel-io added the potential release blocker Flagged by community members using "@bazel-io flag". Should be added to a release blocker milestone label Apr 6, 2023
@copybara-service copybara-service bot closed this in 6d6fa81 Apr 6, 2023
@ShreeM01
Copy link
Contributor

ShreeM01 commented Apr 6, 2023

@bazel-io fork 6.2.0

@bazel-io bazel-io removed the potential release blocker Flagged by community members using "@bazel-io flag". Should be added to a release blocker milestone label Apr 6, 2023
ShreeM01 pushed a commit to ShreeM01/bazel that referenced this pull request Apr 6, 2023
Currently, it's possible for concurrent actions to end up computing the same Merkle tree, even when the cache is enabled. This change makes it so that a later action waits for the completion of the computation started by an earlier action.

Progress on bazelbuild#17923.

Closes bazelbuild#17995.

PiperOrigin-RevId: 522319291
Change-Id: I68ab952ed6357027ec71a67a104f91a684a7a040
ShreeM01 added a commit that referenced this pull request Apr 11, 2023
Currently, it's possible for concurrent actions to end up computing the same Merkle tree, even when the cache is enabled. This change makes it so that a later action waits for the completion of the computation started by an earlier action.

Progress on #17923.

Closes #17995.

PiperOrigin-RevId: 522319291
Change-Id: I68ab952ed6357027ec71a67a104f91a684a7a040

Co-authored-by: Tiago Quelhas <tjgq@google.com>
fweikert pushed a commit to fweikert/bazel that referenced this pull request May 25, 2023
Currently, it's possible for concurrent actions to end up computing the same Merkle tree, even when the cache is enabled. This change makes it so that a later action waits for the completion of the computation started by an earlier action.

Progress on bazelbuild#17923.

Closes bazelbuild#17995.

PiperOrigin-RevId: 522319291
Change-Id: I68ab952ed6357027ec71a67a104f91a684a7a040
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
awaiting-review PR is awaiting review from an assigned reviewer team-Remote-Exec Issues and PRs for the Execution (Remote) team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants