Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Hive write to bucketed table when native writers disabled #18672

Merged
merged 2 commits into from
Aug 14, 2023

Conversation

findepi
Copy link
Member

@findepi findepi commented Aug 14, 2023

Fixes #18667

Based on #18669, only two last commits should be reviewed here.

@@ -32,6 +32,7 @@
import io.trino.filesystem.Location;
import io.trino.filesystem.TrinoFileSystem;
import io.trino.filesystem.TrinoFileSystemFactory;
import io.trino.filesystem.TrinoOutputFile;
Copy link
Member

@losipiuk losipiuk Aug 14, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you make commit summary of Fix Hive write to bucketed table when native writers disabled Reverts "Use Hive native writers for creating empty bucket files" - so it is obvious this is a single commit revert.

Add context why it is reverted later in commit message

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am following the pattern from #18612
The revert commit is clearly marked as such in the message, but not in the title.

Here, I didn't expand in the commit body on why I revert, because it's all in the title/summary line.

`TestHiveConnectorTest.testWithAllStorageFormats` is supposed to exercise
format configurations, including different reader/writer
implementations. For example it exercised two Parquet writers until
1339286 when one was removed. This
commit adds same improved test coverage for other file formats which
have two execution paths.
@findepi findepi force-pushed the findepi/native-bucket branch from 8ba5a4e to 2f1e8ec Compare August 14, 2023 15:02
@findepi
Copy link
Member Author

findepi commented Aug 14, 2023

rebased after #18669 merged

@findepi findepi merged commit f6fce51 into trinodb:master Aug 14, 2023
@findepi findepi deleted the findepi/native-bucket branch August 14, 2023 15:02
@github-actions github-actions bot added this to the 424 milestone Aug 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed hive Hive connector
Development

Successfully merging this pull request may close these issues.

Hive fails to create bucketed table when native writers disable and creating empty buckets enabled
2 participants