Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: Fix accidental quadratic parquet metadata #18327

Merged
merged 6 commits into from
Aug 23, 2024
Merged

perf: Fix accidental quadratic parquet metadata #18327

merged 6 commits into from
Aug 23, 2024

Conversation

ritchie46
Copy link
Member

@ritchie46 ritchie46 commented Aug 23, 2024

#18319

Have to follow up for statistics as well.

@github-actions github-actions bot added performance Performance issues or improvements python Related to Python Polars rust Related to Rust Polars labels Aug 23, 2024
@@ -23,29 +22,3 @@ where
reader.take(length).read_to_end(&mut chunk).await?;
Result::Ok(chunk)
}

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Drive by: unused

Copy link

codecov bot commented Aug 23, 2024

Codecov Report

Attention: Patch coverage is 99.12281% with 1 line in your changes missing coverage. Please review.

Project coverage is 80.45%. Comparing base (764ee49) to head (9071121).
Report is 12 commits behind head on main.

Files Patch % Lines
crates/polars-io/src/parquet/read/metadata.rs 96.96% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #18327      +/-   ##
==========================================
+ Coverage   80.43%   80.45%   +0.02%     
==========================================
  Files        1492     1492              
  Lines      198677   198718      +41     
  Branches     2841     2841              
==========================================
+ Hits       159804   159882      +78     
+ Misses      38348    38311      -37     
  Partials      525      525              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@ritchie46 ritchie46 merged commit d6703c4 into main Aug 23, 2024
22 checks passed
@ritchie46 ritchie46 deleted the parquet branch August 23, 2024 16:31
@c-peters c-peters added the accepted Ready for implementation label Aug 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
accepted Ready for implementation performance Performance issues or improvements python Related to Python Polars rust Related to Rust Polars
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

2 participants