Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[branch-2.0](cherry-pick)fix insert overwrite getExecTimeout error #33049

Merged
merged 1 commit into from
Mar 30, 2024

Conversation

zddr
Copy link
Contributor

@zddr zddr commented Mar 29, 2024

Proposed changes

Issue Number: close #xxx

pick from #28700

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Mar 29, 2024

run buildall

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Mar 29, 2024
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 49869 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 040dda6eab19d762f2824365c9d6861977b915e8, data reload: false

------ Round 1 ----------------------------------
q1	17734	4381	4387	4381
q2	2045	154	145	145
q3	10496	1889	1923	1889
q4	10333	1267	1323	1267
q5	8384	3968	3947	3947
q6	235	121	120	120
q7	2034	1614	1609	1609
q8	9515	2700	2703	2700
q9	11106	10442	10443	10442
q10	8656	3518	3521	3518
q11	421	233	237	233
q12	453	298	301	298
q13	18331	3959	4029	3959
q14	353	329	324	324
q15	505	448	457	448
q16	696	589	595	589
q17	1118	945	936	936
q18	7312	6770	6903	6770
q19	1678	1499	1522	1499
q20	513	313	300	300
q21	4477	4162	4101	4101
q22	500	396	394	394
Total cold run time: 116895 ms
Total hot run time: 49869 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4287	4297	4262	4262
q2	315	220	220	220
q3	4179	4120	4168	4120
q4	2747	2758	2733	2733
q5	7269	7193	7223	7193
q6	235	119	119	119
q7	3192	2890	2826	2826
q8	4305	4451	4477	4451
q9	17056	16954	17009	16954
q10	4265	4248	4230	4230
q11	756	699	675	675
q12	1034	855	851	851
q13	7146	3747	3769	3747
q14	443	424	442	424
q15	494	462	465	462
q16	782	708	715	708
q17	3768	3843	3877	3843
q18	8821	8830	8786	8786
q19	1692	1710	1660	1660
q20	2386	2167	2108	2108
q21	8634	8615	8554	8554
q22	1077	960	976	960
Total cold run time: 84883 ms
Total hot run time: 79886 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 202191 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 040dda6eab19d762f2824365c9d6861977b915e8, data reload: false

query1	947	417	399	399
query2	6631	2204	2148	2148
query3	7082	213	208	208
query4	21826	18451	17941	17941
query5	19860	6543	6471	6471
query6	421	213	225	213
query7	5184	303	303	303
query8	263	227	252	227
query9	3190	2741	2673	2673
query10	482	280	315	280
query11	11349	10651	10679	10651
query12	126	71	71	71
query13	5606	625	648	625
query14	19338	13751	13546	13546
query15	361	232	243	232
query16	6422	276	259	259
query17	1331	1534	854	854
query18	2285	400	420	400
query19	197	145	147	145
query20	75	75	72	72
query21	187	99	93	93
query22	5171	4987	4854	4854
query23	32542	32041	31906	31906
query24	6728	6502	6469	6469
query25	532	442	401	401
query26	529	169	161	161
query27	1746	301	294	294
query28	6093	2262	2243	2243
query29	2988	2891	2626	2626
query30	233	159	162	159
query31	912	740	757	740
query32	64	63	58	58
query33	397	257	260	257
query34	874	475	489	475
query35	1108	910	896	896
query36	1402	1203	1217	1203
query37	87	66	68	66
query38	3069	2966	2957	2957
query39	1376	1311	1323	1311
query40	205	96	102	96
query41	36	32	32	32
query42	92	88	77	77
query43	639	792	527	527
query44	1125	723	723	723
query45	235	231	227	227
query46	1262	966	985	966
query47	1888	1870	1819	1819
query48	985	690	681	681
query49	610	376	379	376
query50	868	631	610	610
query51	4782	4616	4660	4616
query52	88	89	71	71
query53	449	316	311	311
query54	2606	2465	2527	2465
query55	84	86	80	80
query56	194	205	203	203
query57	1215	1188	1076	1076
query58	217	202	201	201
query59	3349	3313	3356	3313
query60	214	202	200	200
query61	89	83	88	83
query62	774	531	573	531
query63	474	335	334	334
query64	2446	1531	1436	1436
query65	3672	3598	3563	3563
query66	759	372	374	372
query67	16995	16722	15593	15593
query68	8363	662	666	662
query69	563	331	350	331
query70	1692	1515	1393	1393
query71	402	302	304	302
query72	6484	3448	3450	3448
query73	727	324	321	321
query74	6431	5901	5867	5867
query75	4506	3658	3693	3658
query76	4685	1172	1207	1172
query77	624	251	253	251
query78	12617	11686	11634	11634
query79	7704	649	646	646
query80	1057	388	404	388
query81	491	229	238	229
query82	1628	97	97	97
query83	172	141	132	132
query84	255	68	70	68
query85	928	279	277	277
query86	348	330	290	290
query87	3216	3097	3065	3065
query88	4966	2321	2335	2321
query89	339	273	276	273
query90	1880	213	206	206
query91	151	116	130	116
query92	57	49	51	49
query93	4191	577	629	577
query94	770	198	203	198
query95	1114	1070	1066	1066
query96	639	327	323	323
query97	6523	6318	6417	6318
query98	186	173	167	167
query99	2943	877	1011	877
Total cold run time: 312018 ms
Total hot run time: 202191 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.35 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 040dda6eab19d762f2824365c9d6861977b915e8, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.05
query4	1.80	0.07	0.06
query5	0.53	0.52	0.52
query6	1.24	0.63	0.62
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.50	0.49
query10	0.54	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.09	0.10
query13	0.61	0.62	0.61
query14	0.78	0.77	0.79
query15	0.78	0.77	0.77
query16	0.36	0.36	0.37
query17	1.02	1.01	1.00
query18	0.22	0.26	0.25
query19	1.92	1.81	1.86
query20	0.01	0.01	0.01
query21	15.46	0.56	0.56
query22	2.24	2.27	1.30
query23	17.23	0.97	1.12
query24	5.90	1.25	0.93
query25	0.41	0.08	0.06
query26	0.62	0.14	0.15
query27	0.05	0.04	0.04
query28	7.12	0.76	0.71
query29	12.78	2.28	2.32
query30	0.64	0.51	0.52
query31	2.81	0.39	0.37
query32	3.39	0.52	0.50
query33	3.10	3.05	3.10
query34	15.32	4.80	4.80
query35	4.84	4.86	4.82
query36	1.16	1.00	1.02
query37	0.05	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.13	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 104.4 s
Total hot run time: 30.35 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 040dda6eab19d762f2824365c9d6861977b915e8 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      33 seconds loaded 861443392 Bytes, about 24 MB/s
Insert into select:       20.2 seconds inserted 10000000 Rows, about 495K ops/s

@dataroaring dataroaring merged commit 2f6e5bf into apache:branch-2.0 Mar 30, 2024
26 of 29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants