Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [chore](config) disable restore_reset_index_id by default #46104 #46126

Merged
merged 1 commit into from
Dec 30, 2024

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #46104

otherwise, the restored inverted index files are not readable.
@Thearas
Copy link
Contributor

Thearas commented Dec 28, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Dec 28, 2024
@Thearas
Copy link
Contributor

Thearas commented Dec 28, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41098 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9b0dd817140b7c00c6f644887ab68ce6d8aabd9b, data reload: false

------ Round 1 ----------------------------------
q1	17795	7681	7393	7393
q2	3066	176	171	171
q3	11240	1179	1152	1152
q4	10918	746	813	746
q5	7846	2908	2781	2781
q6	243	154	152	152
q7	982	622	618	618
q8	9411	1998	2028	1998
q9	6776	6436	6379	6379
q10	6995	2250	2300	2250
q11	452	257	261	257
q12	420	207	206	206
q13	17778	2988	3061	2988
q14	237	209	215	209
q15	576	533	535	533
q16	695	599	614	599
q17	970	519	536	519
q18	7197	6776	6778	6776
q19	1395	1003	985	985
q20	477	213	199	199
q21	3991	3182	3208	3182
q22	1111	1005	1008	1005
Total cold run time: 110571 ms
Total hot run time: 41098 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7278	7282	7202	7202
q2	327	230	227	227
q3	3199	3010	2967	2967
q4	2032	1784	1804	1784
q5	5706	5722	5667	5667
q6	232	143	144	143
q7	2240	1800	1815	1800
q8	3355	3501	3490	3490
q9	8819	8877	8740	8740
q10	3606	3569	3543	3543
q11	602	506	502	502
q12	820	637	604	604
q13	6148	3094	2978	2978
q14	282	271	263	263
q15	569	498	515	498
q16	713	653	665	653
q17	1784	1574	1555	1555
q18	7826	7503	7318	7318
q19	1655	1497	1579	1497
q20	2038	1836	1796	1796
q21	5427	5203	5329	5203
q22	1101	1027	971	971
Total cold run time: 65759 ms
Total hot run time: 59401 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191501 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9b0dd817140b7c00c6f644887ab68ce6d8aabd9b, data reload: false

query1	961	368	392	368
query2	6537	2159	2104	2104
query3	6711	212	214	212
query4	34220	23534	23394	23394
query5	4359	468	448	448
query6	274	194	204	194
query7	4625	315	320	315
query8	298	229	232	229
query9	9468	2680	2674	2674
query10	467	265	251	251
query11	18009	15155	15135	15135
query12	155	98	101	98
query13	1636	420	394	394
query14	8947	7111	7157	7111
query15	254	171	175	171
query16	8093	468	457	457
query17	1616	546	530	530
query18	2126	302	303	302
query19	373	150	142	142
query20	116	111	107	107
query21	58	44	47	44
query22	4876	4498	4506	4498
query23	34757	34354	33886	33886
query24	11062	2785	2788	2785
query25	645	383	376	376
query26	1420	165	165	165
query27	2802	291	299	291
query28	8033	2464	2437	2437
query29	879	419	413	413
query30	319	168	171	168
query31	1029	804	808	804
query32	102	57	57	57
query33	791	294	293	293
query34	943	486	510	486
query35	889	753	736	736
query36	1128	960	971	960
query37	152	68	73	68
query38	4049	3931	3874	3874
query39	1498	1440	1435	1435
query40	213	82	83	82
query41	56	49	47	47
query42	115	100	95	95
query43	533	513	506	506
query44	1311	806	796	796
query45	180	167	169	167
query46	1161	706	699	699
query47	1923	1839	1863	1839
query48	472	360	380	360
query49	1178	372	371	371
query50	798	395	401	395
query51	7327	7149	7045	7045
query52	98	89	89	89
query53	253	181	177	177
query54	1178	446	441	441
query55	75	77	73	73
query56	257	245	247	245
query57	1257	1117	1113	1113
query58	217	207	201	201
query59	3471	3191	3106	3106
query60	288	264	254	254
query61	111	111	103	103
query62	890	703	672	672
query63	219	195	186	186
query64	5608	763	629	629
query65	3336	3178	3196	3178
query66	1445	317	318	317
query67	16206	15672	15494	15494
query68	4030	573	594	573
query69	426	272	260	260
query70	1128	1106	1125	1106
query71	328	249	247	247
query72	6521	4169	4038	4038
query73	747	346	352	346
query74	9954	9034	8919	8919
query75	3390	2613	2661	2613
query76	2745	995	1132	995
query77	432	306	292	292
query78	10317	9599	9648	9599
query79	1086	592	587	587
query80	598	442	410	410
query81	479	240	237	237
query82	207	117	111	111
query83	161	141	144	141
query84	234	77	79	77
query85	720	299	281	281
query86	308	289	298	289
query87	4436	4379	4242	4242
query88	3606	2370	2330	2330
query89	403	282	297	282
query90	1910	189	188	188
query91	181	147	148	147
query92	58	50	52	50
query93	1010	546	538	538
query94	767	333	295	295
query95	349	249	249	249
query96	599	276	275	275
query97	3308	3212	3199	3199
query98	214	219	199	199
query99	1497	1294	1298	1294
Total cold run time: 297002 ms
Total hot run time: 191501 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.3 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9b0dd817140b7c00c6f644887ab68ce6d8aabd9b, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.07
query4	1.62	0.10	0.10
query5	0.52	0.52	0.54
query6	1.13	0.75	0.73
query7	0.03	0.02	0.01
query8	0.04	0.04	0.03
query9	0.58	0.50	0.50
query10	0.54	0.53	0.56
query11	0.14	0.11	0.10
query12	0.14	0.12	0.11
query13	0.62	0.59	0.59
query14	2.94	3.05	3.08
query15	0.90	0.81	0.81
query16	0.37	0.38	0.38
query17	1.02	0.98	1.05
query18	0.23	0.21	0.22
query19	1.93	1.88	2.00
query20	0.01	0.01	0.01
query21	15.37	0.58	0.57
query22	2.51	2.17	1.88
query23	17.11	0.98	0.91
query24	3.02	1.16	2.21
query25	0.26	0.06	0.10
query26	0.61	0.14	0.14
query27	0.04	0.03	0.04
query28	9.62	1.11	1.07
query29	12.55	3.30	3.24
query30	0.25	0.06	0.06
query31	2.86	0.40	0.37
query32	3.23	0.45	0.47
query33	2.99	3.01	3.01
query34	17.01	4.43	4.55
query35	4.55	4.54	4.49
query36	0.65	0.50	0.47
query37	0.10	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.02	0.02
query40	0.16	0.12	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.21 s
Total hot run time: 33.3 s

@w41ter w41ter merged commit 3369a27 into branch-3.0 Dec 30, 2024
21 checks passed
@w41ter w41ter deleted the auto-pick-46104-branch-3.0 branch December 30, 2024 03:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants