Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use bigger data set to address testStatsBasedRepartitionData flakiness #17431

Conversation

findepi
Copy link
Member

@findepi findepi commented May 10, 2023

Previously the test used tpch.tiny.nation. The tiny schema is sf0.01. Now will use sf0.03. Since the test requires source table to have stats, a copy of the table is created.

Despite the increased data size locally the test runs faster now. This is because the test internally uses retries to cover flakiness and now it needs fewer retries to succeed (usually no retries).

Fixes #11140

@findepi findepi added test no-release-notes This pull request does not require release notes entry labels May 10, 2023
@cla-bot cla-bot bot added the cla-signed label May 10, 2023
findepi added 2 commits May 10, 2023 10:57
The source table, tpch.tiny.orders, has 15K rows.
Previously the test used `tpch.tiny.nation`. The tiny schema is sf0.01.
Now will use sf0.03. Since the test requires source table to have stats,
a copy of the table is created.

Despite the increased data size locally the test runs faster now. This
is because the test internally uses retries to cover flakiness and now
it needs fewer retries to succeed (usually no retries).
@findepi findepi force-pushed the findepi/use-bigger-data-set-to-address-teststatsbasedrepartitiondata-flakiness-0f249c branch from 9174e8c to 88eb9a1 Compare May 10, 2023 08:57
@findepi
Copy link
Member Author

findepi commented May 10, 2023

Best reviewed with Hide whitespace option

@github-actions github-actions bot added the iceberg Iceberg connector label May 10, 2023
@findepi findepi merged commit 7ed9b2e into trinodb:master May 11, 2023
@findepi findepi deleted the findepi/use-bigger-data-set-to-address-teststatsbasedrepartitiondata-flakiness-0f249c branch May 11, 2023 20:03
@github-actions github-actions bot added this to the 418 milestone May 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed iceberg Iceberg connector no-release-notes This pull request does not require release notes entry test
Development

Successfully merging this pull request may close these issues.

testStatsBasedRepartitionDataOnInsert flaky
2 participants