Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mark new tasks readyForScheduling when fragment children are finished #20736

Merged
merged 5 commits into from
Feb 26, 2024

Conversation

losipiuk
Copy link
Member

No description provided.

@losipiuk losipiuk added the no-release-notes This pull request does not require release notes entry label Feb 16, 2024
@losipiuk losipiuk requested a review from dekimir February 16, 2024 16:57
@cla-bot cla-bot bot added the cla-signed label Feb 16, 2024
Copy link
Contributor

@dekimir dekimir left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One nitpick, otherwise LGTM.

@@ -109,6 +109,7 @@
import it.unimi.dsi.fastutil.ints.IntOpenHashSet;
import it.unimi.dsi.fastutil.ints.IntSet;
import jakarta.annotation.Nullable;
import jakarta.ws.rs.HEAD;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you help me understand why this new import is necessary?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:)

This is artifact of IntelliJ doing automatic imports. And conflict resolition with

HEAD <<<<<<<<<<<

makers

Makes isReadyForExecution() resilient to changes in estimate
classification.
Previously, StageExecution#updatePartition() always created new tasks as speculative.  But if the
fragment's children are completed, the task is not really speculative -- it can get scheduled without fear
of its precursors failing.
@losipiuk losipiuk merged commit 60c94a3 into trinodb:master Feb 26, 2024
78 of 94 checks passed
@github-actions github-actions bot added this to the 440 milestone Feb 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed no-release-notes This pull request does not require release notes entry
Development

Successfully merging this pull request may close these issues.

3 participants