Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce experimental multithreaded interleave transformation. #624

Closed
wants to merge 0 commits into from

Conversation

copybara-service[bot]
Copy link

@copybara-service copybara-service bot commented Nov 15, 2024

Introduce experimental multithreaded interleave transformation.

We will support new file formats that do not allow random access. This transformation will allow to implement parallel reads and hierarchical shuffle for them.

@copybara-service copybara-service bot force-pushed the test_696887656 branch 5 times, most recently from bde8ed1 to 4196398 Compare November 15, 2024 17:31
@copybara-service copybara-service bot changed the title Introduce experimental interleave transformation. Introduce experimental multithreaded interleave transformation. Nov 15, 2024
@copybara-service copybara-service bot force-pushed the test_696887656 branch 2 times, most recently from 4b12b4b to 1199fd8 Compare November 18, 2024 23:20
@copybara-service copybara-service bot closed this Nov 18, 2024
@copybara-service copybara-service bot deleted the test_696887656 branch November 18, 2024 23:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants