Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](build index)Fix build index failed on renamed column (#42882)(#43246)(#43336) #43266

Merged
merged 4 commits into from
Nov 7, 2024

Conversation

qidaye
Copy link
Contributor

@qidaye qidaye commented Nov 5, 2024

bp #42882 #43246 #43336
We pick these PRs together because they all fix one problem and if not do so, the regression test won't be passed.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@qidaye
Copy link
Contributor Author

qidaye commented Nov 5, 2024

run buildall

Copy link
Contributor

github-actions bot commented Nov 5, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.30% (9461/26061)
Line Coverage: 27.86% (77937/279695)
Region Coverage: 26.53% (39993/150729)
Branch Coverage: 23.32% (20315/87122)
Coverage Report: http://coverage.selectdb-in.cc/coverage/72b6a702071c96cecc6d74ea442c885a67694e3d_72b6a702071c96cecc6d74ea442c885a67694e3d/report/index.html

@qidaye
Copy link
Contributor Author

qidaye commented Nov 5, 2024

run buildall

Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

github-actions bot commented Nov 5, 2024

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Nov 5, 2024
Copy link
Contributor

github-actions bot commented Nov 5, 2024

PR approved by anyone and no changes requested.

Copy link
Contributor

github-actions bot commented Nov 5, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.30% (9461/26061)
Line Coverage: 27.86% (77929/279695)
Region Coverage: 26.53% (39994/150729)
Branch Coverage: 23.32% (20317/87122)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0825a0c8554dc92da3d06ac7e7a81194402c6c39_0825a0c8554dc92da3d06ac7e7a81194402c6c39/report/index.html

@qidaye
Copy link
Contributor Author

qidaye commented Nov 5, 2024

run buildall

Copy link
Contributor

github-actions bot commented Nov 5, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.31% (9463/26061)
Line Coverage: 27.87% (77936/279690)
Region Coverage: 26.53% (39993/150726)
Branch Coverage: 23.32% (20315/87120)
Coverage Report: http://coverage.selectdb-in.cc/coverage/cd7bd7a0706e40fdfb9062c45430caa61ca35187_cd7bd7a0706e40fdfb9062c45430caa61ca35187/report/index.html

@qidaye
Copy link
Contributor Author

qidaye commented Nov 6, 2024

run buildall

Copy link
Contributor

github-actions bot commented Nov 6, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.30% (9461/26061)
Line Coverage: 27.86% (77913/279697)
Region Coverage: 26.52% (39978/150730)
Branch Coverage: 23.31% (20306/87124)
Coverage Report: http://coverage.selectdb-in.cc/coverage/2da5471c8e971c63f9d99decf5536b700ebde6aa_2da5471c8e971c63f9d99decf5536b700ebde6aa/report/index.html

@qidaye qidaye marked this pull request as draft November 6, 2024 07:13
qidaye and others added 3 commits November 7, 2024 11:40
)

Add `column_unique_ids` in `TOlapTableIndex` thrift struct, to get
col_unique_id when building index.
### What problem does this PR solve?
<!--
You need to clearly describe your PR in this part:

1. What problem was fixed (it's best to include specific error reporting
information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what
is it now, why was it modified, and what possible impacts might there
be.
3. What features were added. Why this function was added.
4. Which codes were refactored and why this part of the code was
refactored.
5. Which functions were optimized and what is the difference before and
after the optimization.

The description of the PR needs to enable reviewers to quickly and
clearly understand the logic of the code modification.
-->

<!--
If there are related issues, please fill in the issue number.
- If you want the issue to be closed after the PR is merged, please use
"close apache#12345". Otherwise, use "ref apache#12345"
-->
Introduced by apache#42882

<!--
If this PR is followup a preivous PR, for example, fix the bug that
introduced by a related PR,
link the PR here
-->
Related PR: apache#42882

Problem Summary:

### Check List (For Committer)

- Test <!-- At least one of them must be included. -->

    - [ ] Regression test
    - [ ] Unit Test
    - [x] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No colde files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

#### TEST
- Upgrade the BE first, then use build index, and it will core dump.
- Manual testing shows that it doesn't core dump after the upgrade.
1. Execute ADD INDEX
2. Upgrade BE
3. Execute BUILD INDEX

- Behavior changed:

    - [x] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?

    - [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->

- Release note

    <!-- bugfix, feat, behavior changed need a release note -->
    <!-- Add one line release note for this PR. -->
    None

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [x] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
…pache#43336)

### What problem does this PR solve?

This PR is a followup repair on the basis of apache#42882.
Building index on renamed column will produce an empty index file, when
`column_idx` is not found.
The query is successful because match without inverted index.
Move test_match_without_index to fault_injection folder and make it
non-concurrent to avoid concurrency issues.
@qidaye qidaye changed the title [fix](build index)Fix build index failed on renamed column (#42882) [fix](build index)Fix build index failed on renamed column (#42882)(#43246)(#43336) Nov 7, 2024
@qidaye qidaye marked this pull request as ready for review November 7, 2024 03:46
@qidaye
Copy link
Contributor Author

qidaye commented Nov 7, 2024

run buildall

Copy link
Contributor

github-actions bot commented Nov 7, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.31% (9463/26061)
Line Coverage: 27.87% (77948/279705)
Region Coverage: 26.54% (39998/150736)
Branch Coverage: 23.32% (20317/87130)
Coverage Report: http://coverage.selectdb-in.cc/coverage/dfc0b80344f91e2dbcf51fbca2dd23839c96cc48_dfc0b80344f91e2dbcf51fbca2dd23839c96cc48/report/index.html

@qidaye
Copy link
Contributor Author

qidaye commented Nov 7, 2024

run buildall

Copy link
Contributor

github-actions bot commented Nov 7, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.31% (9463/26061)
Line Coverage: 27.86% (77933/279705)
Region Coverage: 26.53% (39991/150736)
Branch Coverage: 23.31% (20311/87130)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7da3c9e8313d5a8efd7410b2603f7a9fb86cb276_7da3c9e8313d5a8efd7410b2603f7a9fb86cb276/report/index.html

@qidaye qidaye merged commit 12bb38e into apache:branch-2.1 Nov 7, 2024
20 of 22 checks passed
@qidaye qidaye deleted the pick_42882_2.1 branch November 7, 2024 13:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants