Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Iceberg partition pruning does not work for predicates not expressible by tuple domain #9309

Closed
losipiuk opened this issue Sep 20, 2021 · 1 comment · Fixed by #9830
Closed

Iceberg partition pruning does not work for predicates not expressible by tuple domain #9309

losipiuk opened this issue Sep 20, 2021 · 1 comment · Fixed by #9830
Assignees
@homar
Labels
enhancement New feature or request

Comments

@losipiuk
Copy link
Member

Partition pruning in Iceberg does not work for filters that are passed via Constraint.predicate (as opposed to Constraint.summary).

Repro:

CREATE TABLE nation_partitioned WITH (partitioning = ARRAY['regionkey']) AS SELECT * FROM nation;
SELECT * FROM nation_partitioned WHERE regionkey % 5 = 3;
-- whole table is read

cc: @findepi
@findepi findepi changed the title Partition prunning does not work for predicates not expressible by tuple domain Iceberg Partition pruning does not work for predicates not expressible by tuple domain Sep 21, 2021
@findepi findepi changed the title Iceberg Partition pruning does not work for predicates not expressible by tuple domain Iceberg partition pruning does not work for predicates not expressible by tuple domain Sep 21, 2021
@findepi findepi mentioned this issue Sep 21, 2021
Closed
93 tasks
@findepi findepi added the enhancement New feature or request label Sep 21, 2021
@findepi
Copy link
Member

findepi commented Sep 21, 2021

May require #7608

@homar homar mentioned this issue Nov 2, 2021
Merged
@homar homar self-assigned this Nov 3, 2021
homar added a commit to homar/trino that referenced this issue Nov 18, 2021
@homar
Filter out splits that do not match predicates not expressible by tup…
a901d2c 
…le domain

fixes trinodb#9309
fixes trinodb#7608
The idea is to push constraint down to split source and not generate splits
that would be filtered out by this constraint's predicate.
findepi pushed a commit that referenced this issue Nov 22, 2021
@homar @findepi
Filter out splits that do not match predicates not expressible by tup…
c973251 
…le domain

fixes #9309
fixes #7608
The idea is to push constraint down to split source and not generate splits
that would be filtered out by this constraint's predicate.
@findepi findepi mentioned this issue Nov 22, 2021
Closed
12 tasks
sumannewton pushed a commit to sumannewton/trino that referenced this issue Jan 17, 2022
@homar @sumannewton
Filter out splits that do not match predicates not expressible by tup…
ca0addc 
…le domain

fixes trinodb#9309
fixes trinodb#7608
The idea is to push constraint down to split source and not generate splits
that would be filtered out by this constraint's predicate.
@findepi findepi mentioned this issue May 25, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@homar homar

Labels
enhancement New feature or request
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Filter out Iceberg splits that do not match predicates not expressible by tuple domain homar/trino
3 participants
@homar @findepi @losipiuk