Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(rust, python): The 1 billion row sort #6156

Merged
merged 9 commits into from
Jan 13, 2023
Merged

feat(rust, python): The 1 billion row sort #6156

merged 9 commits into from
Jan 13, 2023

Conversation

ritchie46
Copy link
Member

@ritchie46 ritchie46 commented Jan 10, 2023

Processed 1B rows 64 GBS of data in 1.52 mins.

image

@ritchie46 ritchie46 force-pushed the ooc_sort branch 2 times, most recently from edb8566 to faa8fc8 Compare January 12, 2023 15:51
@ritchie46 ritchie46 changed the title WIP: the billion row sort The 10 billion row sort Jan 13, 2023
@ritchie46 ritchie46 changed the title The 10 billion row sort The 1 billion row sort Jan 13, 2023
@ritchie46 ritchie46 changed the title The 1 billion row sort feat(rust, python): The 1 billion row sort Jan 13, 2023
@ritchie46 ritchie46 merged commit 1a51f9e into master Jan 13, 2023
@ritchie46 ritchie46 deleted the ooc_sort branch January 13, 2023 17:48
@github-actions github-actions bot added enhancement New feature or an improvement of an existing feature python Related to Python Polars rust Related to Rust Polars labels Jan 13, 2023
@akhildevelops
Copy link

Please share the dataset on which this test run was done.

@ritchie46
Copy link
Member Author

Please share the dataset on which this test run was done.

Did you see the image? I create the dataset in the first cell.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or an improvement of an existing feature python Related to Python Polars rust Related to Rust Polars
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants