Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[C++][Parquet] Skip pages based on header metadata using a callback #43001

Closed
asfimport opened this issue Oct 31, 2022 · 1 comment
Closed

[C++][Parquet] Skip pages based on header metadata using a callback #43001

asfimport opened this issue Oct 31, 2022 · 1 comment

Comments

@asfimport
Copy link
Collaborator

asfimport commented Oct 31, 2022

Currently, we do not expose the page header metadata and they cannot be used for skipping pages. I propose exposing the metadata through a callback that would allow the caller to decide if they want to read or skip the page based on the metadata. The signature of the callback would be the following: std::function<bool(const format::PageHeader&)> skip_page_callback)

Reporter: fatemah / @fatemehp
Assignee: fatemah / @fatemehp

Related issues:

PRs and other links:

Note: This issue was originally created as PARQUET-2210. Please see the migration documentation for further details.

@asfimport
Copy link
Collaborator Author

Micah Kornfield / @emkornfield:
Issue resolved by pull request 14603
#14603

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant