Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Drop helping tables when the whole table is done in clickhouse-copier #19743

Merged
merged 1 commit into from
Feb 9, 2021

Conversation

mdianjun
Copy link
Contributor

@mdianjun mdianjun commented Jan 28, 2021

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

Changelog category (leave one):

  • Bug Fix

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Fix a bug that moving pieces to destination table may failed in case of launching multiple clickhouse-copiers.

Detailed description / Documentation draft:

When launching multiple clickhouse-copiers, the one moving pieces to destination table may spend long time. However, before it finished, the others had executed tryProcessTable() beyond max_table_tries times, and then all the piece tables had been dropped. As a result, the pieces moving failed.

@alexey-milovidov

@robot-clickhouse robot-clickhouse added the pr-bugfix Pull request with bugfix, not backported by default label Jan 28, 2021
@mdianjun
Copy link
Contributor Author

I'm confused why AST fuzzer (UBSan) failed. @akuzm Could you give me a few more details, please?

@mdianjun
Copy link
Contributor Author

mdianjun commented Feb 4, 2021

@nikitamikhaylov PTAL.

@nikitamikhaylov
Copy link
Member

I'm confused why AST fuzzer (UBSan) failed. @akuzm Could you give me a few more details, please?

Our AST Fuzzer processes all test queries for each commits, not only yours or related to this PR. That's why it fails. The true way to deal with it is to find the query on which ClickHouse crashes, validate it and submit an issue with tag fuzz.

@nikitamikhaylov nikitamikhaylov merged commit e024029 into ClickHouse:master Feb 9, 2021
robot-clickhouse pushed a commit that referenced this pull request Feb 9, 2021
robot-clickhouse pushed a commit that referenced this pull request Feb 9, 2021
robot-clickhouse pushed a commit that referenced this pull request Feb 9, 2021
robot-clickhouse pushed a commit that referenced this pull request Feb 9, 2021
nikitamikhaylov added a commit that referenced this pull request Feb 10, 2021
Backport #19743 to 21.2: Drop helping tables when the whole table is done in clickhouse-copier
nikitamikhaylov added a commit that referenced this pull request Feb 10, 2021
Backport #19743 to 20.12: Drop helping tables when the whole table is done in clickhouse-copier
nikitamikhaylov added a commit that referenced this pull request Feb 10, 2021
Backport #19743 to 21.1: Drop helping tables when the whole table is done in clickhouse-copier
nikitamikhaylov added a commit that referenced this pull request Feb 10, 2021
Backport #19743 to 20.11: Drop helping tables when the whole table is done in clickhouse-copier
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pr-bugfix Pull request with bugfix, not backported by default
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants