Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dereference Pushdown for Iceberg Connector #5179

Closed
phd3 opened this issue Sep 15, 2020 · 0 comments · Fixed by #8129
Closed

Dereference Pushdown for Iceberg Connector #5179

phd3 opened this issue Sep 15, 2020 · 0 comments · Fixed by #8129
Assignees

Comments

@phd3
Copy link
Member

phd3 commented Sep 15, 2020

Similar to #1720 , we should push down the dereference expressions in the Iceberg connector.

Iceberg provides dotted name-based access to sub columns (e.g. string "a.b" to get the nested field id), so the implementation should be simpler compared to hive connector. I'm working on some refactoring in hive connector to extract out common code that can be reused for Iceberg connector dereference pushdown.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging a pull request may close this issue.

4 participants