Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix for excessive memory usage when reading parquet #5516

Merged
merged 1 commit into from
May 22, 2024

Conversation

malhotrashivam
Copy link
Contributor

@malhotrashivam malhotrashivam commented May 22, 2024

This bug occurs when reading a column from parquet file which has a single parquet page.

@malhotrashivam malhotrashivam added bug Something isn't working parquet Related to the Parquet integration NoDocumentationNeeded NoReleaseNotesNeeded No release notes are needed. labels May 22, 2024
@malhotrashivam malhotrashivam added this to the 3. May 2024 milestone May 22, 2024
@malhotrashivam malhotrashivam self-assigned this May 22, 2024
@malhotrashivam malhotrashivam changed the title Added fix for excessive memory usage when reading single page columns Added fix for excessive memory usage when reading parquet May 22, 2024
@rcaudy rcaudy added ReleaseNotesNeeded Release notes are needed and removed NoReleaseNotesNeeded No release notes are needed. labels May 22, 2024
@malhotrashivam malhotrashivam merged commit bccecf5 into deephaven:main May 22, 2024
27 checks passed
@malhotrashivam malhotrashivam changed the title Added fix for excessive memory usage when reading parquet Fixed excessive memory usage when reading parquet May 22, 2024
@github-actions github-actions bot locked and limited conversation to collaborators May 22, 2024
@malhotrashivam malhotrashivam changed the title Fixed excessive memory usage when reading parquet Fix for excessive memory usage when reading parquet May 22, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working NoDocumentationNeeded parquet Related to the Parquet integration ReleaseNotesNeeded Release notes are needed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants