Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[1.6] Core: Drop ParallelIterable's queue low water mark #10979

Conversation

findepi
Copy link
Member

@findepi findepi commented Aug 20, 2024

As part of the change in commit
7831a8d, queue low water mark was introduced. However, it resulted in increased number of manifests being read when planning LIMIT queries in Trino Iceberg connector. To avoid increased I/O, back out the change for now.

This is cherry pick of #10978 into 1.6.x branch

As part of the change in commit
7831a8d, queue low water mark was
introduced. However, it resulted in increased number of manifests being
read when planning LIMIT queries in Trino Iceberg connector. To avoid
increased I/O, back out the change for now.
@github-actions github-actions bot added the core label Aug 20, 2024
Copy link
Contributor

@Fokko Fokko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since this reverts to the original behavior 👍

@findepi findepi merged commit ed53c6d into apache:1.6.x Aug 21, 2024
49 checks passed
@findepi findepi deleted the findepi/1.6.x/drop-paralleliterable-s-queue-low-water-mark-1fd7b3 branch August 21, 2024 22:05
@Fokko Fokko added this to the Iceberg 1.6.1 milestone Aug 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants