Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](merge-on-write) when full clone failed, duplicate key might occur (#37001) #37229

Merged
merged 1 commit into from
Jul 3, 2024

Conversation

zhannngchen
Copy link
Contributor

Proposed changes

cherry-pick #37001

…ur (apache#37001)

## Proposed changes

Issue Number: close #xxx

introduced by apache#31268

full clone failure may produce duplicate keys in mow table
the bug would be triggered in the following condition:
1. replica 0 miss version
2. replica 0 try to do full clone from other replicas
3. the full clone failed and the delete bitmap is overrided incorrectly
4. replica 0 try to do incremental clone again and this time the clone
succeed
5. incremental clone can't fix the delete bitmap overrided by previous
failed full clone
6. duplicate key occurred

solution:
for full clone, don't override the delete bitmap, use `merge()` method
instead.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zhannngchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

github-actions bot commented Jul 3, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.33% (9149/25186)
Line Coverage: 27.87% (74679/267939)
Region Coverage: 26.77% (38505/143861)
Branch Coverage: 23.46% (19510/83170)
Coverage Report: http://coverage.selectdb-in.cc/coverage/9a946c4c131470e162c302800aa379d3f44ec001_9a946c4c131470e162c302800aa379d3f44ec001/report/index.html

@zhannngchen zhannngchen merged commit 97945af into apache:branch-2.1 Jul 3, 2024
20 of 22 checks passed
@yiguolei yiguolei mentioned this pull request Jul 19, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants