Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parquet: Support definition-driven partition parsing for key=value directory-based partitioning #4284

Merged
merged 6 commits into from
Aug 8, 2023

Conversation

rcaudy
Copy link
Member

@rcaudy rcaudy commented Aug 7, 2023

Closes #4258

To use:

    public static Table readDefinedKeyValuePartitionedTable(
            @NotNull final File directory,
            @NotNull final ParquetInstructions readInstructions,
            @NotNull final TableDefinition tableDefinition) {
        return TableTools.readPartitionedTable(
                new ParquetKeyValuePartitionedLayout(directory, tableDefinition),
                readInstructions,
                tableDefinition);
    }

@rcaudy rcaudy added core Core development tasks parquet Related to the Parquet integration DocumentationNeeded ReleaseNotesNeeded Release notes are needed labels Aug 7, 2023
@rcaudy rcaudy added this to the July 2023 milestone Aug 7, 2023
@rcaudy rcaudy self-assigned this Aug 7, 2023
@rcaudy rcaudy requested review from lbooker42 and malhotrashivam and removed request for nbauernfeind August 7, 2023 23:44
@rcaudy rcaudy merged commit f59b724 into deephaven:main Aug 8, 2023
10 checks passed
@rcaudy rcaudy deleted the rwc-pkvdef branch August 8, 2023 15:33
@github-actions github-actions bot locked and limited conversation to collaborators Aug 8, 2023
@deephaven-internal
Copy link
Contributor

Labels indicate documentation is required. Issues for documentation have been opened:

How-to: https://github.com/deephaven/deephaven.io/issues/3004
Reference: https://github.com/deephaven/deephaven.io/issues/3005

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
core Core development tasks DocumentationNeeded parquet Related to the Parquet integration ReleaseNotesNeeded Release notes are needed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Pass Definition to Parquet KV Partition Reading
3 participants