Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-6378][CH] Support delta count optimizer for the MergeTree format #6379

Merged
merged 2 commits into from
Jul 9, 2024

Conversation

zzcclp
Copy link
Contributor

@zzcclp zzcclp commented Jul 9, 2024

What changes were proposed in this pull request?

[CH] Support delta count optimizer for the MergeTree format:

In Delta, it will use the rule PrepareDeltaScan to optimize the count command, which will directly use the delta meta to response the sql select count(*) from table, now support this optimizer for the MergeTree format.

Close #6378.
(Fixes: #6378)

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

@zzcclp zzcclp requested a review from baibaichen July 9, 2024 07:21
Copy link

github-actions bot commented Jul 9, 2024

#6378

Copy link

github-actions bot commented Jul 9, 2024

Run Gluten Clickhouse CI

1 similar comment
Copy link

github-actions bot commented Jul 9, 2024

Run Gluten Clickhouse CI

Support delta count optimizer for the MergeTree format:

In Delta, it will use the rule PrepareDeltaScan to optimize the count command, which will directly use the delta meta to response the sql select count(*) from table, now support this optimizer for the MergeTree format.

Close apache#6378.
Copy link

github-actions bot commented Jul 9, 2024

Run Gluten Clickhouse CI

Copy link

github-actions bot commented Jul 9, 2024

Run Gluten Clickhouse CI

@baibaichen baibaichen merged commit ca35e47 into apache:main Jul 9, 2024
5 checks passed
@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_07_09_2024_time.csv log/native_master_07_08_2024_97d0f18c1_time.csv difference percentage
q1 36.53 34.69 -1.838 94.97%
q2 22.47 23.85 1.372 106.10%
q3 38.91 38.33 -0.581 98.51%
q4 31.14 31.32 0.182 100.58%
q5 70.60 68.03 -2.575 96.35%
q6 7.61 7.70 0.088 101.16%
q7 86.01 80.37 -5.643 93.44%
q8 85.73 84.50 -1.230 98.57%
q9 122.14 124.34 2.196 101.80%
q10 46.37 48.36 1.998 104.31%
q11 20.27 20.16 -0.106 99.48%
q12 23.99 28.04 4.052 116.89%
q13 38.82 37.95 -0.863 97.78%
q14 17.56 20.41 2.847 116.21%
q15 33.88 29.61 -4.270 87.40%
q16 14.18 14.78 0.598 104.22%
q17 102.32 101.16 -1.161 98.87%
q18 149.22 147.36 -1.859 98.75%
q19 13.77 13.95 0.182 101.32%
q20 26.63 30.49 3.860 114.49%
q21 265.27 263.82 -1.451 99.45%
q22 13.09 12.64 -0.441 96.63%
total 1266.51 1261.86 -4.643 99.63%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CH] Support delta count optimizer for the MergeTree format
3 participants