Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix]fix be core when migration tablet to other disk #37712

Merged
merged 3 commits into from
Jul 18, 2024
Merged

[fix]fix be core when migration tablet to other disk #37712

merged 3 commits into from
Jul 18, 2024

Conversation

z404289981
Copy link
Contributor

image
The asynchronous task reference captures a local variable

Proposed changes

Issue Number: close #36809

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

dataroaring
dataroaring approved these changes Jul 13, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 13, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@bobhan1
Copy link
Contributor

bobhan1 commented Jul 13, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39629 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a29b688dd3e55ee8d5426bf20eeb36a8ea01b2cc, data reload: false

------ Round 1 ----------------------------------
q1	17618	4377	4266	4266
q2	2005	190	190	190
q3	10455	1202	1065	1065
q4	10187	929	738	738
q5	7529	2730	2615	2615
q6	225	134	139	134
q7	962	600	585	585
q8	9293	2088	2072	2072
q9	8878	6572	6546	6546
q10	8821	3856	3765	3765
q11	464	230	234	230
q12	424	223	216	216
q13	17906	2944	2999	2944
q14	271	233	224	224
q15	529	477	467	467
q16	509	375	368	368
q17	973	579	622	579
q18	8130	7582	7454	7454
q19	6321	1403	1419	1403
q20	671	320	314	314
q21	4939	3195	3171	3171
q22	346	283	287	283
Total cold run time: 117456 ms
Total hot run time: 39629 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4439	4251	4246	4246
q2	363	262	258	258
q3	3021	2912	2919	2912
q4	2035	1732	1769	1732
q5	5656	5570	5496	5496
q6	230	135	129	129
q7	2250	1931	1836	1836
q8	3240	3405	3438	3405
q9	8717	8858	8801	8801
q10	4188	3729	3827	3729
q11	573	498	495	495
q12	799	656	651	651
q13	16014	3108	3225	3108
q14	320	292	287	287
q15	530	486	488	486
q16	519	437	448	437
q17	1805	1503	1509	1503
q18	8237	7903	7811	7811
q19	1736	1558	1711	1558
q20	2172	1892	1879	1879
q21	8872	4812	4850	4812
q22	588	515	499	499
Total cold run time: 76304 ms
Total hot run time: 56070 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173346 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a29b688dd3e55ee8d5426bf20eeb36a8ea01b2cc, data reload: false

query1	914	378	366	366
query2	6453	1909	1891	1891
query3	6636	206	213	206
query4	28620	17591	17329	17329
query5	3611	503	482	482
query6	265	174	167	167
query7	4580	293	285	285
query8	237	192	203	192
query9	8668	2406	2389	2389
query10	444	305	279	279
query11	11967	10104	10048	10048
query12	117	93	82	82
query13	1632	386	372	372
query14	10208	7827	7728	7728
query15	210	171	167	167
query16	7691	320	313	313
query17	1807	567	524	524
query18	1909	287	291	287
query19	210	156	157	156
query20	91	83	82	82
query21	218	126	127	126
query22	4244	4059	3912	3912
query23	34093	33882	33654	33654
query24	10934	2920	2930	2920
query25	604	427	377	377
query26	782	153	159	153
query27	2306	278	283	278
query28	6218	2058	2058	2058
query29	886	685	625	625
query30	261	153	155	153
query31	979	762	751	751
query32	94	53	56	53
query33	767	329	292	292
query34	961	505	510	505
query35	682	572	593	572
query36	1154	1004	971	971
query37	144	94	81	81
query38	2969	2831	2877	2831
query39	926	806	801	801
query40	208	120	121	120
query41	51	44	44	44
query42	119	95	104	95
query43	492	467	458	458
query44	1242	750	753	750
query45	207	161	158	158
query46	1085	727	724	724
query47	1840	1732	1740	1732
query48	375	297	294	294
query49	841	418	424	418
query50	794	397	394	394
query51	6987	6740	6775	6740
query52	108	92	96	92
query53	357	292	293	292
query54	889	453	449	449
query55	74	73	75	73
query56	307	267	275	267
query57	1147	1055	1055	1055
query58	242	253	245	245
query59	2913	2611	2575	2575
query60	302	283	280	280
query61	101	125	94	94
query62	786	653	627	627
query63	314	292	296	292
query64	9301	2218	1674	1674
query65	3185	3076	3089	3076
query66	756	323	328	323
query67	15344	14993	14992	14992
query68	6102	542	542	542
query69	741	463	357	357
query70	1189	1173	1058	1058
query71	472	293	281	281
query72	7272	5315	5685	5315
query73	801	328	325	325
query74	5970	5540	5484	5484
query75	3824	2672	2718	2672
query76	4014	940	953	940
query77	671	314	304	304
query78	9675	9154	8982	8982
query79	2196	529	523	523
query80	1874	485	482	482
query81	589	226	220	220
query82	1396	136	134	134
query83	268	172	179	172
query84	278	86	88	86
query85	1297	306	298	298
query86	464	323	325	323
query87	3242	3090	3208	3090
query88	4053	2525	2461	2461
query89	483	391	385	385
query90	2211	196	197	196
query91	136	104	101	101
query92	60	53	52	52
query93	2309	492	502	492
query94	1048	212	210	210
query95	409	322	324	322
query96	627	278	274	274
query97	3216	3037	3031	3031
query98	230	196	197	196
query99	1688	1265	1247	1247
Total cold run time: 284664 ms
Total hot run time: 173346 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.18 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a29b688dd3e55ee8d5426bf20eeb36a8ea01b2cc, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.03
query3	0.22	0.05	0.05
query4	1.68	0.08	0.08
query5	0.51	0.50	0.48
query6	1.13	0.72	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.56	0.50	0.50
query10	0.54	0.54	0.54
query11	0.15	0.11	0.11
query12	0.15	0.11	0.12
query13	0.58	0.58	0.58
query14	0.76	0.77	0.83
query15	0.85	0.82	0.82
query16	0.37	0.36	0.36
query17	0.98	0.94	0.97
query18	0.22	0.22	0.21
query19	1.81	1.69	1.65
query20	0.01	0.01	0.02
query21	15.43	0.79	0.67
query22	4.60	7.19	1.49
query23	18.27	1.34	1.35
query24	2.16	0.23	0.24
query25	0.17	0.08	0.09
query26	0.32	0.21	0.21
query27	0.46	0.24	0.22
query28	13.19	1.01	0.99
query29	12.62	3.35	3.30
query30	0.25	0.06	0.05
query31	2.86	0.37	0.38
query32	3.31	0.49	0.48
query33	2.85	2.97	2.87
query34	17.07	4.33	4.30
query35	4.43	4.48	4.49
query36	0.66	0.49	0.48
query37	0.19	0.16	0.15
query38	0.15	0.15	0.15
query39	0.04	0.03	0.04
query40	0.16	0.12	0.13
query41	0.09	0.04	0.05
query42	0.07	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 110.1 s
Total hot run time: 30.18 s

@z404289981
Copy link
Contributor Author

@bobhan1 @gavinchou @dataroaring Hi, Some regression cases failed and have nothing to do with modifications. Could you please tell me if this is a known issue in the master branch? thank you

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@bobhan1
Copy link
Contributor

bobhan1 commented Jul 15, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40362 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ba8e68c96bb82b9b81e5d756bd4e26a478b53427, data reload: false

------ Round 1 ----------------------------------
q1	17626	4358	4288	4288
q2	2009	193	185	185
q3	10735	1250	1132	1132
q4	10532	857	837	837
q5	7817	2745	2691	2691
q6	224	140	146	140
q7	986	621	614	614
q8	9335	2121	2093	2093
q9	9065	6678	6694	6678
q10	9093	3759	3773	3759
q11	437	236	253	236
q12	407	229	221	221
q13	17933	2980	3008	2980
q14	289	242	242	242
q15	523	476	474	474
q16	509	381	374	374
q17	969	659	731	659
q18	8097	7421	7386	7386
q19	5819	1473	1473	1473
q20	697	335	330	330
q21	4883	3287	3300	3287
q22	359	298	283	283
Total cold run time: 118344 ms
Total hot run time: 40362 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4437	4310	4259	4259
q2	364	280	265	265
q3	3041	2918	2969	2918
q4	2028	1677	1728	1677
q5	5538	5549	5622	5549
q6	229	142	143	142
q7	2306	1878	1923	1878
q8	3304	3401	3342	3342
q9	8787	8762	8760	8760
q10	4072	3942	3897	3897
q11	591	517	518	517
q12	880	666	623	623
q13	17622	3198	3191	3191
q14	328	286	288	286
q15	527	492	478	478
q16	502	451	433	433
q17	1807	1534	1503	1503
q18	8139	8077	7565	7565
q19	1715	1444	1561	1444
q20	2549	1867	1846	1846
q21	5217	4856	4850	4850
q22	624	511	515	511
Total cold run time: 74607 ms
Total hot run time: 55934 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174809 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ba8e68c96bb82b9b81e5d756bd4e26a478b53427, data reload: false

query1	918	372	365	365
query2	6206	1860	1826	1826
query3	6645	216	216	216
query4	28086	17872	17489	17489
query5	3846	496	518	496
query6	287	166	163	163
query7	4591	287	302	287
query8	239	201	190	190
query9	8454	2402	2399	2399
query10	446	287	291	287
query11	12467	10341	10192	10192
query12	143	85	88	85
query13	1649	369	368	368
query14	10288	7493	8152	7493
query15	215	173	176	173
query16	7634	327	317	317
query17	1667	585	570	570
query18	1942	296	290	290
query19	211	163	160	160
query20	96	84	91	84
query21	215	140	139	139
query22	4271	4372	4112	4112
query23	34093	33724	33843	33724
query24	12090	3053	2941	2941
query25	708	457	437	437
query26	1770	157	157	157
query27	2951	281	298	281
query28	7480	2019	2010	2010
query29	1100	684	670	670
query30	271	159	173	159
query31	1012	759	792	759
query32	110	62	64	62
query33	783	336	330	330
query34	979	509	518	509
query35	705	615	610	610
query36	1156	984	982	982
query37	278	79	88	79
query38	2915	2803	2791	2791
query39	888	836	849	836
query40	262	125	121	121
query41	50	45	43	43
query42	125	100	100	100
query43	496	479	454	454
query44	1209	757	746	746
query45	192	159	159	159
query46	1094	733	741	733
query47	1835	1770	1770	1770
query48	369	317	295	295
query49	994	416	428	416
query50	781	403	404	403
query51	6883	6793	6713	6713
query52	110	93	103	93
query53	362	297	296	296
query54	916	446	447	446
query55	79	73	73	73
query56	309	273	276	273
query57	1166	1027	1060	1027
query58	255	275	256	256
query59	2765	2616	2711	2616
query60	334	281	285	281
query61	100	98	96	96
query62	801	663	658	658
query63	325	300	298	298
query64	10364	2326	1719	1719
query65	3200	3136	3163	3136
query66	1285	336	330	330
query67	15609	15109	14964	14964
query68	8494	546	559	546
query69	706	460	386	386
query70	1253	1172	1154	1154
query71	520	288	292	288
query72	7688	5630	5992	5630
query73	1040	332	326	326
query74	6115	5649	5752	5649
query75	4433	2701	2709	2701
query76	4858	1062	1030	1030
query77	711	305	311	305
query78	9880	9626	8899	8899
query79	8183	515	519	515
query80	1336	495	483	483
query81	568	218	220	218
query82	791	138	141	138
query83	227	170	170	170
query84	279	97	89	89
query85	1367	307	301	301
query86	326	295	297	295
query87	3372	3107	3097	3097
query88	4805	2475	2461	2461
query89	543	397	396	396
query90	1687	201	205	201
query91	133	103	103	103
query92	64	50	53	50
query93	6108	508	497	497
query94	645	214	214	214
query95	400	334	335	334
query96	658	279	279	279
query97	3207	3033	3053	3033
query98	225	210	194	194
query99	1680	1305	1274	1274
Total cold run time: 304377 ms
Total hot run time: 174809 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.64 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ba8e68c96bb82b9b81e5d756bd4e26a478b53427, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.03
query3	0.22	0.05	0.05
query4	1.95	0.06	0.07
query5	0.48	0.49	0.47
query6	1.13	0.73	0.73
query7	0.02	0.01	0.01
query8	0.06	0.05	0.04
query9	0.56	0.48	0.50
query10	0.54	0.54	0.55
query11	0.16	0.12	0.11
query12	0.15	0.12	0.13
query13	0.60	0.58	0.60
query14	0.76	0.79	0.77
query15	0.87	0.82	0.82
query16	0.38	0.37	0.35
query17	1.02	1.02	0.99
query18	0.23	0.21	0.23
query19	1.84	1.76	1.74
query20	0.01	0.01	0.02
query21	15.39	0.75	0.66
query22	4.48	7.49	1.78
query23	18.27	1.41	1.30
query24	2.14	0.23	0.23
query25	0.15	0.09	0.08
query26	0.30	0.21	0.21
query27	0.46	0.23	0.24
query28	13.22	1.02	1.01
query29	12.64	3.27	3.29
query30	0.25	0.07	0.06
query31	2.88	0.40	0.39
query32	3.28	0.48	0.47
query33	2.90	2.92	2.94
query34	17.07	4.46	4.39
query35	4.46	4.43	4.56
query36	0.65	0.48	0.48
query37	0.19	0.16	0.16
query38	0.16	0.16	0.15
query39	0.05	0.03	0.04
query40	0.15	0.12	0.13
query41	0.09	0.04	0.04
query42	0.05	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.38 s
Total hot run time: 30.64 s

@z404289981
Copy link
Contributor Author

run external

@z404289981
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40698 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ba8e68c96bb82b9b81e5d756bd4e26a478b53427, data reload: false

------ Round 1 ----------------------------------
q1	18211	4831	4487	4487
q2	2558	197	192	192
q3	11485	1267	1213	1213
q4	11191	836	760	760
q5	7740	2794	2758	2758
q6	227	142	140	140
q7	969	628	603	603
q8	9265	2130	2150	2130
q9	8737	6612	6614	6612
q10	8783	3818	3843	3818
q11	482	245	244	244
q12	407	239	228	228
q13	17820	2983	2965	2965
q14	297	233	236	233
q15	527	477	492	477
q16	492	374	388	374
q17	981	706	740	706
q18	8193	7594	7387	7387
q19	7925	1476	1452	1452
q20	698	317	330	317
q21	4923	3945	3326	3326
q22	349	286	276	276
Total cold run time: 122260 ms
Total hot run time: 40698 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4470	4332	4282	4282
q2	394	268	255	255
q3	3023	2789	2776	2776
q4	1897	1591	1576	1576
q5	5333	5344	5346	5344
q6	219	130	132	130
q7	2147	1790	1753	1753
q8	3266	3398	3313	3313
q9	8506	8459	8407	8407
q10	3903	3724	3716	3716
q11	596	487	501	487
q12	782	594	611	594
q13	17485	2973	2996	2973
q14	305	272	261	261
q15	516	477	470	470
q16	460	416	416	416
q17	1806	1464	1478	1464
q18	7695	7524	7386	7386
q19	1670	1687	1553	1553
q20	1993	1755	1818	1755
q21	4981	4644	4756	4644
q22	566	503	514	503
Total cold run time: 72013 ms
Total hot run time: 54058 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172920 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ba8e68c96bb82b9b81e5d756bd4e26a478b53427, data reload: false

query1	935	382	373	373
query2	6447	1847	1735	1735
query3	6652	208	217	208
query4	28111	17316	17331	17316
query5	4209	500	479	479
query6	275	176	166	166
query7	4609	296	285	285
query8	254	191	203	191
query9	8369	2399	2354	2354
query10	466	282	268	268
query11	12123	10034	10030	10030
query12	134	97	80	80
query13	1645	371	369	369
query14	10322	7552	7573	7552
query15	231	165	169	165
query16	7805	335	307	307
query17	1765	553	515	515
query18	1960	273	270	270
query19	194	146	150	146
query20	86	80	83	80
query21	203	131	123	123
query22	4367	4058	4036	4036
query23	33789	33162	33071	33071
query24	12176	2828	2872	2828
query25	667	379	392	379
query26	1818	154	151	151
query27	2989	273	276	273
query28	7728	1996	1989	1989
query29	1209	654	633	633
query30	279	151	152	151
query31	974	748	760	748
query32	97	58	59	58
query33	798	316	309	309
query34	945	494	498	494
query35	700	611	572	572
query36	1111	944	957	944
query37	284	82	84	82
query38	2868	2777	2725	2725
query39	871	820	844	820
query40	286	124	123	123
query41	50	48	48	48
query42	119	102	107	102
query43	497	471	452	452
query44	1263	757	737	737
query45	202	163	166	163
query46	1095	730	713	713
query47	1862	1793	1807	1793
query48	380	300	294	294
query49	1196	425	426	425
query50	782	388	399	388
query51	6941	6835	6859	6835
query52	103	90	101	90
query53	355	291	293	291
query54	972	469	468	468
query55	78	75	77	75
query56	310	299	291	291
query57	1188	1036	1065	1036
query58	257	246	252	246
query59	2816	2745	2661	2661
query60	324	297	309	297
query61	119	121	119	119
query62	842	657	772	657
query63	321	292	284	284
query64	10493	2232	1682	1682
query65	3262	3122	3089	3089
query66	1305	338	336	336
query67	15909	15041	14945	14945
query68	4727	563	542	542
query69	694	435	340	340
query70	1180	1181	1063	1063
query71	484	286	282	282
query72	8563	5575	5394	5394
query73	756	328	326	326
query74	6117	5625	5704	5625
query75	4117	2699	2675	2675
query76	3727	1000	968	968
query77	713	307	303	303
query78	10548	9562	9200	9200
query79	2728	535	532	532
query80	2541	528	491	491
query81	606	217	224	217
query82	738	146	143	143
query83	317	174	177	174
query84	277	85	91	85
query85	2127	317	307	307
query86	466	312	277	277
query87	3280	3082	3137	3082
query88	4607	2465	2467	2465
query89	489	406	399	399
query90	1958	198	203	198
query91	138	143	102	102
query92	69	51	51	51
query93	3397	509	511	509
query94	1303	216	215	215
query95	412	329	324	324
query96	611	282	273	273
query97	3175	2981	3037	2981
query98	232	198	202	198
query99	1596	1314	1264	1264
Total cold run time: 296485 ms
Total hot run time: 172920 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.92 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ba8e68c96bb82b9b81e5d756bd4e26a478b53427, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.04	0.04
query3	0.22	0.06	0.05
query4	1.66	0.10	0.09
query5	0.50	0.49	0.51
query6	1.13	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.55	0.48	0.48
query10	0.55	0.53	0.54
query11	0.16	0.11	0.11
query12	0.16	0.13	0.13
query13	0.62	0.59	0.60
query14	0.76	0.78	0.78
query15	0.86	0.83	0.83
query16	0.36	0.37	0.35
query17	0.95	1.04	0.98
query18	0.24	0.22	0.22
query19	1.82	1.73	1.67
query20	0.01	0.01	0.01
query21	15.42	0.74	0.66
query22	3.88	7.28	2.22
query23	18.26	1.35	1.32
query24	2.08	0.24	0.22
query25	0.15	0.09	0.08
query26	0.31	0.21	0.22
query27	0.46	0.23	0.22
query28	13.24	1.02	1.01
query29	12.62	3.32	3.28
query30	0.25	0.06	0.06
query31	2.87	0.40	0.38
query32	3.26	0.47	0.47
query33	2.90	2.89	2.93
query34	17.00	4.34	4.35
query35	4.42	4.37	4.37
query36	0.66	0.46	0.50
query37	0.18	0.17	0.16
query38	0.16	0.15	0.14
query39	0.04	0.04	0.03
query40	0.15	0.12	0.12
query41	0.10	0.05	0.05
query42	0.06	0.04	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.25 s
Total hot run time: 30.92 s

@z404289981
Copy link
Contributor Author

run cloud_p0

@z404289981
Copy link
Contributor Author

run arm_p0

@z404289981
Copy link
Contributor Author

run cloud_p0

2 similar comments
@z404289981
Copy link
Contributor Author

run cloud_p0

@z404289981
Copy link
Contributor Author

run cloud_p0

@z404289981
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39897 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit edfbfd2db53f3e88e689d1a325d9a79ba70cc473, data reload: false

------ Round 1 ----------------------------------
q1	17615	4289	4281	4281
q2	2014	192	192	192
q3	10445	1147	1101	1101
q4	10183	786	751	751
q5	7552	2688	2714	2688
q6	219	137	140	137
q7	951	612	619	612
q8	9242	2071	2054	2054
q9	8813	6551	6521	6521
q10	8910	3813	3782	3782
q11	486	235	240	235
q12	476	225	233	225
q13	17768	3003	3008	3003
q14	268	236	239	236
q15	522	477	498	477
q16	494	396	380	380
q17	955	682	732	682
q18	7992	7486	7381	7381
q19	7315	1408	1400	1400
q20	682	330	342	330
q21	4893	3184	3144	3144
q22	347	285	291	285
Total cold run time: 118142 ms
Total hot run time: 39897 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4375	4233	4247	4233
q2	387	259	271	259
q3	2974	2939	2885	2885
q4	1959	1703	1706	1703
q5	5707	5578	5537	5537
q6	226	139	142	139
q7	2240	1839	1871	1839
q8	3257	3450	3394	3394
q9	8786	8785	8833	8785
q10	4158	3805	3873	3805
q11	610	522	506	506
q12	819	643	656	643
q13	17070	3175	3241	3175
q14	315	293	296	293
q15	531	484	497	484
q16	495	439	450	439
q17	1808	1518	1519	1518
q18	8168	7838	7893	7838
q19	1785	1561	1528	1528
q20	2242	1905	1870	1870
q21	7317	4780	4711	4711
q22	577	510	518	510
Total cold run time: 75806 ms
Total hot run time: 56094 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173095 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit edfbfd2db53f3e88e689d1a325d9a79ba70cc473, data reload: false

query1	924	374	368	368
query2	6448	1844	1780	1780
query3	6650	207	219	207
query4	27309	17579	17333	17333
query5	3774	495	480	480
query6	261	175	168	168
query7	4594	302	290	290
query8	249	205	187	187
query9	8512	2377	2346	2346
query10	427	285	274	274
query11	10833	9985	9998	9985
query12	116	92	79	79
query13	1643	363	362	362
query14	10225	7666	7265	7265
query15	216	166	170	166
query16	7663	319	326	319
query17	1351	583	546	546
query18	1971	288	288	288
query19	215	153	165	153
query20	91	85	86	85
query21	216	129	123	123
query22	4347	4120	4004	4004
query23	34166	33718	33785	33718
query24	11304	2974	2998	2974
query25	621	383	384	383
query26	707	155	153	153
query27	2266	286	290	286
query28	6547	2036	2038	2036
query29	871	659	640	640
query30	253	158	161	158
query31	989	759	779	759
query32	101	54	62	54
query33	762	299	287	287
query34	1081	501	502	501
query35	698	572	554	554
query36	1121	983	977	977
query37	154	86	90	86
query38	3051	2822	2841	2822
query39	915	886	848	848
query40	224	123	118	118
query41	49	47	44	44
query42	107	97	112	97
query43	526	491	475	475
query44	1283	732	718	718
query45	196	162	162	162
query46	1088	764	730	730
query47	1863	1751	1774	1751
query48	365	297	288	288
query49	850	422	423	422
query50	780	392	401	392
query51	6844	6701	6754	6701
query52	101	91	94	91
query53	356	293	285	285
query54	888	448	441	441
query55	75	73	75	73
query56	299	254	262	254
query57	1145	1039	1053	1039
query58	243	247	253	247
query59	2782	2656	2613	2613
query60	305	275	279	275
query61	99	96	95	95
query62	789	669	646	646
query63	313	293	292	292
query64	9396	2263	1683	1683
query65	3170	3097	3158	3097
query66	751	330	334	330
query67	15430	15027	14914	14914
query68	4458	545	540	540
query69	604	441	372	372
query70	1188	1119	1145	1119
query71	424	289	280	280
query72	7130	5381	6099	5381
query73	767	330	321	321
query74	6117	5672	5630	5630
query75	3444	2694	2734	2694
query76	2821	921	1008	921
query77	655	304	306	304
query78	9665	8987	9596	8987
query79	2740	605	542	542
query80	2013	510	480	480
query81	606	221	225	221
query82	726	144	143	143
query83	338	171	174	171
query84	273	91	93	91
query85	1752	329	311	311
query86	465	334	293	293
query87	3259	3123	3091	3091
query88	4210	2375	2344	2344
query89	485	388	388	388
query90	1808	204	195	195
query91	127	102	152	102
query92	61	53	52	52
query93	4332	510	509	509
query94	1147	214	220	214
query95	403	324	317	317
query96	625	271	265	265
query97	3192	3033	3093	3033
query98	215	221	205	205
query99	1582	1262	1270	1262
Total cold run time: 281591 ms
Total hot run time: 173095 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.29 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit edfbfd2db53f3e88e689d1a325d9a79ba70cc473, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.66	0.09	0.09
query5	0.48	0.48	0.47
query6	1.17	0.73	0.72
query7	0.01	0.01	0.02
query8	0.05	0.04	0.05
query9	0.56	0.49	0.48
query10	0.55	0.55	0.55
query11	0.15	0.11	0.12
query12	0.15	0.12	0.12
query13	0.59	0.58	0.59
query14	0.77	0.80	0.78
query15	0.86	0.83	0.82
query16	0.37	0.36	0.36
query17	1.02	1.04	0.99
query18	0.23	0.22	0.22
query19	1.87	1.70	1.69
query20	0.01	0.01	0.00
query21	15.40	0.75	0.65
query22	3.82	6.54	2.63
query23	18.28	1.36	1.29
query24	2.11	0.23	0.22
query25	0.15	0.09	0.08
query26	0.31	0.22	0.21
query27	0.45	0.23	0.23
query28	13.31	1.04	1.01
query29	12.62	3.26	3.31
query30	0.25	0.06	0.06
query31	2.89	0.40	0.39
query32	3.24	0.50	0.47
query33	2.89	2.92	2.86
query34	16.99	4.36	4.43
query35	4.45	4.42	4.38
query36	0.65	0.47	0.49
query37	0.19	0.14	0.15
query38	0.15	0.15	0.14
query39	0.04	0.04	0.03
query40	0.16	0.13	0.12
query41	0.09	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.38 s
Total hot run time: 31.29 s

dataroaring
dataroaring approved these changes Jul 18, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 05a0c5d into apache:master Jul 18, 2024
25 of 27 checks passed
@xiaokang xiaokang added the p0_c label Jul 18, 2024
gavinchou pushed a commit to gavinchou/doris that referenced this pull request Jul 18, 2024
@z404289981 @gavinchou
[fix]fix be core when migration tablet to other disk (apache#37712)
287b217 
![image](https://github.com/user-attachments/assets/01f67160-3ebe-41a1-ac79-a7173d14605c)
The asynchronous task reference captures a local variable

## Proposed changes

Issue Number: close apache#36809

<!--Describe your changes.-->

Co-authored-by: huronghui <huronghui@huronghuideMac-mini.local>
yiguolei pushed a commit that referenced this pull request Jul 18, 2024
@gavinchou @z404289981
[fix]fix be core when migration tablet to other disk (#37712) (#38062)
b7c038e 
![image](https://github.com/user-attachments/assets/01f67160-3ebe-41a1-ac79-a7173d14605c)
The asynchronous task reference captures a local variable
Issue Number: close #36809

Co-authored-by: z404289981 <123865460+z404289981@users.noreply.github.com>
Co-authored-by: huronghui <huronghui@huronghuideMac-mini.local>
dataroaring pushed a commit that referenced this pull request Jul 19, 2024
@z404289981 @dataroaring
[fix]fix be core when migration tablet to other disk (#37712)
ada72fd 
![image](https://github.com/user-attachments/assets/01f67160-3ebe-41a1-ac79-a7173d14605c)
The asynchronous task reference captures a local variable

## Proposed changes

Issue Number: close #36809

<!--Describe your changes.-->

Co-authored-by: huronghui <huronghui@huronghuideMac-mini.local>
@xiaokang xiaokang mentioned this pull request Aug 1, 2024
Merged
xiaokang pushed a commit to xiaokang/doris that referenced this pull request Aug 1, 2024
@z404289981 @xiaokang
[fix]fix be core when migration tablet to other disk (apache#37712)
37ebab8 
![image](https://github.com/user-attachments/assets/01f67160-3ebe-41a1-ac79-a7173d14605c)
The asynchronous task reference captures a local variable

## Proposed changes

Issue Number: close apache#36809

<!--Describe your changes.-->

Co-authored-by: huronghui <huronghui@huronghuideMac-mini.local>
xiaokang added a commit that referenced this pull request Aug 1, 2024
@xiaokang
[fix]fix be core when migration tablet to other disk #37712 (#38726)
6a54e57 
Co-authored-by: z404289981
@gavinchou gavinchou mentioned this pull request Aug 19, 2024
Open
mongo360 pushed a commit to mongo360/doris that referenced this pull request Dec 11, 2024
@xiaokang
[fix]fix be core when migration tablet to other disk apache#37712 (ap…
3cf911d 
…ache#38726)

Co-authored-by: z404289981
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dataroaring dataroaring dataroaring approved these changes

@bobhan1 bobhan1 bobhan1 approved these changes

@gavinchou gavinchou gavinchou approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.14-merged dev/2.1.5-merged dev/3.0.1-merged p0_c reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Bug] be core when migration tablet to other disk
7 participants
@z404289981 @doris-robot @bobhan1 @gavinchou @dataroaring @xiaokang @wm1581066