Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](compatibility) type toSql should return lowercase string (#38012) #38521

Merged
merged 1 commit into from
Aug 1, 2024
Merged

[fix](compatibility) type toSql should return lowercase string (#38012) #38521

merged 1 commit into from
Aug 1, 2024

Conversation

morrySnow
Copy link
Contributor

pick from master #38012

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morrySnow
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added the area/planner Issues or PRs related to the query planner label Jul 30, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 49733 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ddd1cbf228a7f88742aebe873474cdf3be563ea8, data reload: false

------ Round 1 ----------------------------------
q1	17568	4383	4336	4336
q2	2092	153	145	145
q3	10262	1912	1941	1912
q4	10320	1279	1335	1279
q5	8400	3813	3913	3813
q6	258	124	124	124
q7	2027	1569	1627	1569
q8	9270	2716	2692	2692
q9	10541	10306	10218	10218
q10	8626	3524	3517	3517
q11	411	249	238	238
q12	464	313	308	308
q13	18333	3982	4033	3982
q14	358	331	329	329
q15	510	447	460	447
q16	681	576	568	568
q17	1117	970	955	955
q18	7384	6838	6860	6838
q19	1796	1649	1610	1610
q20	517	297	318	297
q21	4475	4127	4111	4111
q22	531	450	445	445
Total cold run time: 115941 ms
Total hot run time: 49733 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4329	4297	4322	4297
q2	314	228	219	219
q3	4208	4159	4159	4159
q4	2776	2755	2770	2755
q5	7095	7085	7049	7049
q6	236	121	118	118
q7	3225	2839	2818	2818
q8	4386	4468	4480	4468
q9	16831	16675	16726	16675
q10	4247	4279	4227	4227
q11	775	705	731	705
q12	1020	840	881	840
q13	6763	3762	3733	3733
q14	442	423	420	420
q15	492	458	455	455
q16	749	682	692	682
q17	3846	3928	3823	3823
q18	8761	8788	8798	8788
q19	1716	1713	1651	1651
q20	2371	2119	2109	2109
q21	8479	8529	8537	8529
q22	1049	975	972	972
Total cold run time: 84110 ms
Total hot run time: 79492 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204494 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ddd1cbf228a7f88742aebe873474cdf3be563ea8, data reload: false

query1	990	438	386	386
query2	6529	2769	2678	2678
query3	6914	203	199	199
query4	21554	18136	18211	18136
query5	19723	6522	6567	6522
query6	293	216	232	216
query7	4154	304	308	304
query8	454	407	492	407
query9	3167	2716	2659	2659
query10	413	313	279	279
query11	11374	10934	10770	10770
query12	125	79	76	76
query13	5608	729	715	715
query14	18920	13727	13380	13380
query15	363	251	252	251
query16	6479	292	266	266
query17	1723	1455	901	901
query18	2292	423	413	413
query19	215	151	149	149
query20	84	81	80	80
query21	195	95	93	93
query22	5166	5022	5002	5002
query23	33264	32610	32314	32314
query24	7028	6493	6497	6493
query25	535	430	438	430
query26	533	161	165	161
query27	1810	297	305	297
query28	6150	2430	2364	2364
query29	2984	2741	2759	2741
query30	245	170	162	162
query31	916	744	758	744
query32	68	65	62	62
query33	400	259	251	251
query34	860	483	482	482
query35	1115	895	923	895
query36	1347	1151	1246	1151
query37	91	62	62	62
query38	3112	2905	2941	2905
query39	1369	1339	1330	1330
query40	206	98	100	98
query41	46	46	45	45
query42	91	97	90	90
query43	674	735	676	676
query44	1133	714	728	714
query45	250	239	233	233
query46	1258	972	973	972
query47	1835	1863	1717	1717
query48	1027	743	739	739
query49	619	382	374	374
query50	856	626	645	626
query51	4735	4699	4679	4679
query52	88	89	78	78
query53	456	337	326	326
query54	2693	2459	2480	2459
query55	96	82	87	82
query56	251	213	211	211
query57	1196	1259	1135	1135
query58	213	206	194	194
query59	4168	3935	3904	3904
query60	224	216	204	204
query61	97	93	98	93
query62	868	509	527	509
query63	491	351	342	342
query64	2511	1558	1351	1351
query65	3666	3571	3531	3531
query66	770	380	374	374
query67	17988	15359	15198	15198
query68	9260	652	668	652
query69	597	366	364	364
query70	1508	1474	1443	1443
query71	420	313	313	313
query72	6710	3469	3473	3469
query73	734	341	330	330
query74	6317	5851	5940	5851
query75	5417	3704	3753	3704
query76	5737	1101	1152	1101
query77	982	260	261	260
query78	12746	11646	12399	11646
query79	10471	640	657	640
query80	1107	403	395	395
query81	494	234	233	233
query82	1498	103	99	99
query83	169	133	124	124
query84	259	73	72	72
query85	874	333	334	333
query86	332	293	272	272
query87	3241	3004	3010	3004
query88	4936	2339	2337	2337
query89	481	287	317	287
query90	1947	218	198	198
query91	175	143	149	143
query92	61	54	55	54
query93	6355	561	582	561
query94	701	207	203	203
query95	1107	1060	1042	1042
query96	660	333	328	328
query97	6485	6326	6362	6326
query98	187	179	178	178
query99	2834	852	854	852
Total cold run time: 321870 ms
Total hot run time: 204494 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.82 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ddd1cbf228a7f88742aebe873474cdf3be563ea8, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.26	0.05	0.04
query4	1.79	0.06	0.07
query5	0.54	0.52	0.53
query6	1.23	0.64	0.62
query7	0.01	0.01	0.00
query8	0.03	0.02	0.03
query9	0.53	0.49	0.50
query10	0.54	0.54	0.55
query11	0.12	0.08	0.08
query12	0.12	0.09	0.10
query13	0.62	0.62	0.62
query14	0.80	0.77	0.80
query15	0.78	0.76	0.77
query16	0.39	0.37	0.39
query17	1.00	1.02	1.01
query18	0.22	0.26	0.26
query19	1.92	1.86	1.85
query20	0.02	0.01	0.01
query21	15.55	0.56	0.55
query22	2.17	2.70	1.54
query23	17.33	0.87	0.94
query24	8.05	1.06	1.05
query25	0.38	0.11	0.06
query26	0.84	0.16	0.15
query27	0.04	0.04	0.04
query28	5.01	0.78	0.75
query29	12.65	2.36	2.29
query30	0.60	0.51	0.53
query31	2.82	0.40	0.38
query32	3.36	0.49	0.50
query33	3.10	3.08	3.08
query34	15.24	4.79	4.81
query35	4.86	4.86	4.86
query36	1.06	1.00	1.02
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.15	0.14	0.15
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.45 s
Total hot run time: 30.82 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit ddd1cbf228a7f88742aebe873474cdf3be563ea8 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50032 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0152fc3ac24dec6ee05621bb2b1ebe9ad285f665, data reload: false

------ Round 1 ----------------------------------
q1	17928	4383	4335	4335
q2	2065	156	150	150
q3	10447	1879	1922	1879
q4	10313	1214	1321	1214
q5	8608	3989	3882	3882
q6	228	149	124	124
q7	2035	1589	1612	1589
q8	9308	2723	2692	2692
q9	11006	10485	10523	10485
q10	8639	3521	3487	3487
q11	417	246	251	246
q12	471	302	313	302
q13	18401	4010	4073	4010
q14	361	343	348	343
q15	503	483	469	469
q16	705	606	608	606
q17	1135	984	964	964
q18	7412	6934	6783	6783
q19	1751	1645	1648	1645
q20	506	314	310	310
q21	4390	4059	4140	4059
q22	541	471	458	458
Total cold run time: 117170 ms
Total hot run time: 50032 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4325	4313	4319	4313
q2	323	224	225	224
q3	4172	4124	4136	4124
q4	2758	2739	2745	2739
q5	7205	7158	7165	7158
q6	234	120	117	117
q7	3254	2841	2867	2841
q8	4351	4486	4477	4477
q9	17349	17018	16871	16871
q10	4227	4289	4283	4283
q11	753	673	670	670
q12	1031	872	865	865
q13	7049	3730	3738	3730
q14	457	427	434	427
q15	498	448	460	448
q16	727	700	681	681
q17	3810	3865	3842	3842
q18	8712	8719	8953	8719
q19	1727	1717	1659	1659
q20	2373	2124	2137	2124
q21	8589	8536	8541	8536
q22	1082	1010	985	985
Total cold run time: 85006 ms
Total hot run time: 79833 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 207149 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0152fc3ac24dec6ee05621bb2b1ebe9ad285f665, data reload: false

query1	958	447	404	404
query2	6549	2669	2588	2588
query3	6920	209	195	195
query4	21398	18282	18176	18176
query5	19724	6652	6617	6617
query6	292	218	228	218
query7	4168	306	314	306
query8	467	394	429	394
query9	3182	2725	2662	2662
query10	434	301	297	297
query11	11402	10766	10871	10766
query12	133	80	80	80
query13	5614	723	741	723
query14	18422	13654	13650	13650
query15	362	239	251	239
query16	6439	287	269	269
query17	1504	1483	916	916
query18	2262	423	418	418
query19	211	156	155	155
query20	84	82	84	82
query21	195	98	103	98
query22	5238	5158	5049	5049
query23	33174	32308	32430	32308
query24	6926	6601	6618	6601
query25	527	430	441	430
query26	526	177	168	168
query27	1830	307	309	307
query28	6141	2403	2352	2352
query29	2882	2701	2717	2701
query30	253	178	175	175
query31	913	775	783	775
query32	66	65	63	63
query33	407	260	261	260
query34	886	491	493	491
query35	1151	960	959	959
query36	1284	1395	1144	1144
query37	99	62	66	62
query38	3185	2960	2941	2941
query39	1399	1321	1351	1321
query40	212	101	101	101
query41	47	44	44	44
query42	81	91	81	81
query43	813	669	688	669
query44	1165	727	732	727
query45	250	244	237	237
query46	1239	969	982	969
query47	1895	1709	1778	1709
query48	1037	724	725	724
query49	639	371	391	371
query50	871	595	609	595
query51	4857	4680	4759	4680
query52	100	77	93	77
query53	447	326	333	326
query54	2729	2490	2516	2490
query55	94	80	88	80
query56	235	220	222	220
query57	1209	1127	1118	1118
query58	240	216	211	211
query59	4606	3977	4012	3977
query60	226	222	209	209
query61	101	98	121	98
query62	827	516	480	480
query63	492	345	352	345
query64	2550	1550	1504	1504
query65	3762	3659	3664	3659
query66	793	385	401	385
query67	16136	15878	17213	15878
query68	9464	677	664	664
query69	588	359	372	359
query70	1711	1505	1405	1405
query71	426	309	312	309
query72	6581	3607	3583	3583
query73	741	321	332	321
query74	6408	5923	5861	5861
query75	5288	3795	3794	3794
query76	5960	1188	1218	1188
query77	984	258	263	258
query78	13179	12146	12148	12146
query79	8312	639	638	638
query80	1502	415	422	415
query81	500	251	258	251
query82	1675	100	107	100
query83	168	140	137	137
query84	253	73	73	73
query85	897	343	350	343
query86	334	304	298	298
query87	3274	3009	3086	3009
query88	4901	2339	2347	2339
query89	371	272	284	272
query90	1965	220	216	216
query91	177	142	156	142
query92	62	56	53	53
query93	6400	594	625	594
query94	708	216	207	207
query95	1122	1073	1095	1073
query96	643	321	320	320
query97	6535	6418	6336	6336
query98	188	190	171	171
query99	2951	1006	950	950
Total cold run time: 319528 ms
Total hot run time: 207149 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.98 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0152fc3ac24dec6ee05621bb2b1ebe9ad285f665, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.05
query4	1.79	0.10	0.08
query5	0.54	0.53	0.53
query6	1.32	0.61	0.63
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.48	0.51
query10	0.54	0.54	0.54
query11	0.12	0.09	0.09
query12	0.11	0.08	0.08
query13	0.62	0.62	0.62
query14	0.79	0.76	0.81
query15	0.80	0.76	0.76
query16	0.37	0.39	0.37
query17	1.02	0.99	1.00
query18	0.22	0.25	0.24
query19	1.93	1.79	1.88
query20	0.02	0.01	0.01
query21	15.46	0.55	0.53
query22	2.07	2.00	1.60
query23	17.16	0.92	1.05
query24	5.06	1.26	1.32
query25	0.42	0.11	0.06
query26	0.57	0.16	0.15
query27	0.05	0.05	0.04
query28	7.46	0.73	0.74
query29	12.65	2.28	2.33
query30	0.59	0.54	0.55
query31	2.82	0.38	0.37
query32	3.38	0.50	0.50
query33	3.08	3.10	3.02
query34	15.26	4.84	4.80
query35	4.89	4.85	4.85
query36	1.07	1.01	1.02
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.15	0.14
query41	0.06	0.01	0.02
query42	0.02	0.02	0.01
query43	0.03	0.02	0.02
Total cold run time: 103.47 s
Total hot run time: 30.98 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 0152fc3ac24dec6ee05621bb2b1ebe9ad285f665 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49822 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8e1d393ed99b38a6764389536ca854a256b9c8ab, data reload: false

------ Round 1 ----------------------------------
q1	18068	4390	4413	4390
q2	2068	158	148	148
q3	10478	1879	1951	1879
q4	10374	1259	1318	1259
q5	8417	3961	3917	3917
q6	283	126	124	124
q7	2051	1608	1619	1608
q8	9506	2710	2706	2706
q9	13834	10305	10317	10305
q10	8628	3524	3550	3524
q11	417	243	239	239
q12	473	302	309	302
q13	18369	3921	4056	3921
q14	356	318	333	318
q15	505	459	459	459
q16	658	565	578	565
q17	1133	947	926	926
q18	7254	6859	6967	6859
q19	1803	1651	1615	1615
q20	519	298	326	298
q21	4389	4107	4019	4019
q22	536	441	450	441
Total cold run time: 120119 ms
Total hot run time: 49822 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4341	4293	4434	4293
q2	323	226	227	226
q3	4180	4131	4145	4131
q4	2751	2729	2733	2729
q5	7185	7140	7069	7069
q6	246	124	125	124
q7	3237	2837	2847	2837
q8	4409	4466	4514	4466
q9	16856	16860	16661	16661
q10	4230	4294	4301	4294
q11	760	683	668	668
q12	1036	865	876	865
q13	6903	3699	3760	3699
q14	458	432	420	420
q15	504	452	458	452
q16	735	684	686	684
q17	3862	3854	3826	3826
q18	8794	8744	8834	8744
q19	1737	1748	1668	1668
q20	2378	2126	2132	2126
q21	8488	8564	8480	8480
q22	1033	958	1026	958
Total cold run time: 84446 ms
Total hot run time: 79420 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203544 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8e1d393ed99b38a6764389536ca854a256b9c8ab, data reload: false

query1	930	424	380	380
query2	6551	2843	2686	2686
query3	6930	206	205	205
query4	20836	18039	18049	18039
query5	19731	6531	6526	6526
query6	281	230	235	230
query7	4152	311	309	309
query8	475	403	439	403
query9	3138	2719	2657	2657
query10	418	304	314	304
query11	11396	10698	10749	10698
query12	125	79	76	76
query13	5600	700	708	700
query14	17569	13465	13726	13465
query15	362	258	242	242
query16	6479	286	270	270
query17	1697	1446	893	893
query18	2308	418	415	415
query19	204	150	148	148
query20	81	77	79	77
query21	194	98	97	97
query22	5215	5035	5092	5035
query23	32478	31921	31852	31852
query24	6990	6513	6514	6513
query25	554	438	433	433
query26	627	167	163	163
query27	2006	293	299	293
query28	6210	2401	2351	2351
query29	2941	2641	2861	2641
query30	238	170	170	170
query31	896	717	765	717
query32	64	65	61	61
query33	410	251	242	242
query34	859	488	476	476
query35	1138	919	924	919
query36	1313	1188	1090	1090
query37	94	64	61	61
query38	3072	2951	2996	2951
query39	1381	1320	1310	1310
query40	227	89	96	89
query41	46	44	45	44
query42	85	90	91	90
query43	719	665	771	665
query44	1179	716	729	716
query45	247	236	244	236
query46	1224	963	975	963
query47	2206	1733	1844	1733
query48	1010	714	743	714
query49	620	375	369	369
query50	862	593	631	593
query51	4755	4689	4646	4646
query52	90	82	74	74
query53	465	325	327	325
query54	2658	2498	2453	2453
query55	83	83	87	83
query56	249	204	213	204
query57	1153	1169	1068	1068
query58	221	197	209	197
query59	4396	4486	4082	4082
query60	226	188	208	188
query61	100	94	98	94
query62	835	465	530	465
query63	484	344	356	344
query64	2534	1530	1496	1496
query65	3647	3560	3554	3554
query66	832	379	380	379
query67	17738	15537	14854	14854
query68	12466	680	661	661
query69	584	371	341	341
query70	2043	1592	1350	1350
query71	412	310	327	310
query72	6515	3447	3481	3447
query73	2277	330	324	324
query74	6268	5851	5773	5773
query75	5581	3818	3722	3722
query76	6973	1171	1203	1171
query77	1178	254	257	254
query78	12739	11510	12059	11510
query79	8615	634	685	634
query80	779	404	432	404
query81	461	239	233	233
query82	236	96	101	96
query83	171	136	134	134
query84	256	72	69	69
query85	856	329	333	329
query86	316	340	341	340
query87	3223	3071	3037	3037
query88	4152	2302	2310	2302
query89	458	295	304	295
query90	1931	222	234	222
query91	173	140	140	140
query92	63	53	55	53
query93	5753	611	579	579
query94	644	205	213	205
query95	1140	1096	1075	1075
query96	646	327	317	317
query97	6557	6424	6461	6424
query98	205	178	174	174
query99	3032	915	803	803
Total cold run time: 321537 ms
Total hot run time: 203544 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.43 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8e1d393ed99b38a6764389536ca854a256b9c8ab, data reload: false

query1	0.02	0.02	0.03
query2	0.08	0.02	0.02
query3	0.25	0.05	0.04
query4	1.78	0.07	0.07
query5	0.54	0.53	0.52
query6	1.31	0.63	0.61
query7	0.01	0.00	0.01
query8	0.03	0.03	0.02
query9	0.53	0.48	0.49
query10	0.53	0.55	0.54
query11	0.13	0.09	0.09
query12	0.11	0.10	0.09
query13	0.62	0.62	0.62
query14	0.79	0.78	0.78
query15	0.78	0.77	0.76
query16	0.37	0.39	0.39
query17	1.01	1.01	1.00
query18	0.21	0.27	0.24
query19	1.83	1.85	1.86
query20	0.01	0.00	0.01
query21	15.46	0.57	0.54
query22	2.35	2.14	1.50
query23	16.62	1.01	0.97
query24	5.52	0.64	0.90
query25	0.37	0.10	0.06
query26	0.58	0.15	0.14
query27	0.04	0.04	0.04
query28	8.04	0.78	0.73
query29	12.68	2.32	2.39
query30	0.59	0.54	0.54
query31	2.81	0.38	0.36
query32	3.39	0.50	0.49
query33	3.08	3.11	3.12
query34	15.27	4.78	4.76
query35	4.87	4.85	4.83
query36	1.05	1.02	1.00
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.01
query40	0.15	0.14	0.14
query41	0.07	0.01	0.02
query42	0.02	0.02	0.02
query43	0.02	0.01	0.02
Total cold run time: 104.04 s
Total hot run time: 30.43 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 8e1d393ed99b38a6764389536ca854a256b9c8ab with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.0 seconds inserted 10000000 Rows, about 476K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49933 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e50cb97529156fa0a83b751ce31c4fd001c1cd3f, data reload: false

------ Round 1 ----------------------------------
q1	17732	4407	4342	4342
q2	2061	159	148	148
q3	10455	1886	1927	1886
q4	10308	1223	1336	1223
q5	8419	3952	3894	3894
q6	247	122	127	122
q7	2063	1622	1613	1613
q8	9304	2737	2701	2701
q9	10957	10555	10416	10416
q10	8596	3541	3514	3514
q11	424	250	249	249
q12	467	302	310	302
q13	18330	3952	4039	3952
q14	360	326	318	318
q15	508	461	468	461
q16	680	580	571	571
q17	1132	972	958	958
q18	7284	6913	6863	6863
q19	1761	1644	1631	1631
q20	550	310	305	305
q21	4485	4184	4040	4040
q22	534	433	424	424
Total cold run time: 116657 ms
Total hot run time: 49933 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4335	4300	4282	4282
q2	331	226	218	218
q3	4170	4139	4158	4139
q4	2744	2768	2751	2751
q5	7194	7161	7123	7123
q6	237	122	122	122
q7	3258	2910	2846	2846
q8	4317	4494	4494	4494
q9	17485	17081	17196	17081
q10	4228	4252	4230	4230
q11	750	720	716	716
q12	1028	856	879	856
q13	6946	3756	3750	3750
q14	459	411	415	411
q15	499	463	458	458
q16	735	676	671	671
q17	3832	3878	3789	3789
q18	8842	8859	8706	8706
q19	1704	1727	1647	1647
q20	2369	2124	2104	2104
q21	8499	8525	8506	8506
q22	1033	937	950	937
Total cold run time: 84995 ms
Total hot run time: 79837 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203356 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e50cb97529156fa0a83b751ce31c4fd001c1cd3f, data reload: false

query1	926	418	372	372
query2	6553	2778	2528	2528
query3	6923	202	199	199
query4	20078	18102	18132	18102
query5	19738	6500	6534	6500
query6	296	217	234	217
query7	4155	301	323	301
query8	409	375	404	375
query9	3112	2669	2595	2595
query10	421	310	296	296
query11	11393	10765	10687	10687
query12	120	82	75	75
query13	5609	720	690	690
query14	18020	13723	13229	13229
query15	390	243	252	243
query16	6465	291	269	269
query17	1725	1459	892	892
query18	2287	422	411	411
query19	200	153	150	150
query20	79	79	77	77
query21	191	97	95	95
query22	5268	5032	5086	5032
query23	32675	32061	31879	31879
query24	6990	6537	6526	6526
query25	517	451	417	417
query26	533	166	161	161
query27	1880	296	294	294
query28	6136	2383	2341	2341
query29	2853	2816	2784	2784
query30	243	168	167	167
query31	934	708	745	708
query32	74	64	61	61
query33	400	257	260	257
query34	851	475	504	475
query35	1143	948	915	915
query36	1283	1218	1268	1218
query37	93	62	62	62
query38	3074	2985	2975	2975
query39	1391	1336	1320	1320
query40	207	92	97	92
query41	45	43	44	43
query42	83	93	84	84
query43	772	688	676	676
query44	1133	733	742	733
query45	249	239	239	239
query46	1226	974	978	974
query47	1982	1836	1883	1836
query48	1018	723	711	711
query49	628	391	376	376
query50	865	619	587	587
query51	4842	4709	4646	4646
query52	93	80	82	80
query53	443	324	325	324
query54	2656	2446	2486	2446
query55	87	85	83	83
query56	248	199	211	199
query57	1232	1020	1148	1020
query58	210	221	208	208
query59	4294	4106	3798	3798
query60	220	215	217	215
query61	100	98	101	98
query62	812	411	457	411
query63	501	352	344	344
query64	2404	1567	1523	1523
query65	3609	3566	3551	3551
query66	808	376	390	376
query67	15649	14896	14683	14683
query68	10309	660	635	635
query69	589	367	350	350
query70	1842	1496	1405	1405
query71	418	305	313	305
query72	6526	3530	3569	3530
query73	736	328	319	319
query74	6366	5864	5882	5864
query75	5391	3747	3666	3666
query76	6522	1207	1214	1207
query77	1140	269	261	261
query78	12660	12056	11796	11796
query79	7029	637	638	637
query80	1087	410	410	410
query81	493	235	235	235
query82	1493	101	102	101
query83	166	137	135	135
query84	262	70	71	70
query85	904	354	346	346
query86	339	294	308	294
query87	3227	3021	3084	3021
query88	4609	2312	2338	2312
query89	379	290	287	287
query90	1934	208	215	208
query91	170	139	141	139
query92	62	59	54	54
query93	5702	600	528	528
query94	712	213	207	207
query95	1110	1067	1054	1054
query96	638	333	327	327
query97	6530	6415	6450	6415
query98	177	173	174	173
query99	2887	895	814	814
Total cold run time: 314253 ms
Total hot run time: 203356 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.12 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e50cb97529156fa0a83b751ce31c4fd001c1cd3f, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.24	0.04	0.05
query4	1.79	0.10	0.08
query5	0.53	0.52	0.52
query6	1.24	0.61	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.03
query9	0.53	0.47	0.47
query10	0.53	0.53	0.55
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.62	0.63	0.62
query14	0.77	0.79	0.79
query15	0.78	0.75	0.76
query16	0.38	0.36	0.36
query17	0.99	1.02	0.99
query18	0.23	0.25	0.25
query19	1.94	1.86	1.86
query20	0.01	0.02	0.01
query21	15.45	0.57	0.56
query22	2.20	2.67	1.55
query23	17.33	0.95	0.85
query24	4.95	2.68	1.38
query25	0.39	0.09	0.06
query26	0.72	0.16	0.14
query27	0.04	0.04	0.04
query28	6.62	0.78	0.75
query29	12.67	2.34	2.31
query30	0.68	0.53	0.52
query31	2.80	0.40	0.38
query32	3.37	0.50	0.49
query33	3.04	3.09	3.08
query34	15.25	4.79	4.78
query35	4.88	4.83	4.86
query36	1.05	1.02	1.01
query37	0.05	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 102.77 s
Total hot run time: 31.12 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e50cb97529156fa0a83b751ce31c4fd001c1cd3f with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49810 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ebf26f6596d3ea331618b479d637a5dd154002b9, data reload: false

------ Round 1 ----------------------------------
q1	18093	4389	4334	4334
q2	2150	160	151	151
q3	10258	1919	1946	1919
q4	10111	1277	1336	1277
q5	8498	3953	3917	3917
q6	236	157	129	129
q7	2081	1597	1591	1591
q8	9550	2758	2720	2720
q9	14051	10851	10191	10191
q10	8646	3519	3540	3519
q11	426	245	243	243
q12	468	315	304	304
q13	18361	3982	4000	3982
q14	355	322	333	322
q15	513	472	457	457
q16	679	569	580	569
q17	1126	926	934	926
q18	7243	6774	7070	6774
q19	1762	1660	1642	1642
q20	570	319	309	309
q21	4392	4218	4107	4107
q22	514	427	448	427
Total cold run time: 120083 ms
Total hot run time: 49810 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4386	4319	4272	4272
q2	324	231	231	231
q3	4187	4134	4126	4126
q4	2782	2781	2758	2758
q5	7207	7191	7159	7159
q6	243	122	122	122
q7	3178	2866	2871	2866
q8	4358	4463	4489	4463
q9	17356	17350	17128	17128
q10	4266	4293	4282	4282
q11	757	714	683	683
q12	1036	856	875	856
q13	6748	3762	3747	3747
q14	460	424	428	424
q15	495	456	453	453
q16	752	687	676	676
q17	3814	3880	3877	3877
q18	8853	8739	8790	8739
q19	1751	1683	1656	1656
q20	2384	2160	2086	2086
q21	8551	8544	8548	8544
q22	1094	950	971	950
Total cold run time: 84982 ms
Total hot run time: 80098 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 205025 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ebf26f6596d3ea331618b479d637a5dd154002b9, data reload: false

query1	942	396	408	396
query2	6530	2784	2639	2639
query3	6944	213	206	206
query4	20164	17927	17936	17927
query5	19742	6522	6516	6516
query6	302	219	238	219
query7	4160	293	304	293
query8	394	422	437	422
query9	3127	2718	2657	2657
query10	409	301	311	301
query11	11298	10865	10782	10782
query12	129	74	82	74
query13	5606	692	701	692
query14	17649	13319	13489	13319
query15	356	241	249	241
query16	6444	286	266	266
query17	1494	1502	889	889
query18	2251	415	409	409
query19	221	151	152	151
query20	80	80	80	80
query21	191	106	97	97
query22	5241	5254	5103	5103
query23	32508	32148	31830	31830
query24	7046	6534	6522	6522
query25	534	440	423	423
query26	536	164	157	157
query27	1893	301	299	299
query28	6165	2401	2340	2340
query29	2948	2618	2698	2618
query30	244	169	166	166
query31	905	737	740	737
query32	74	64	60	60
query33	385	282	253	253
query34	850	488	472	472
query35	1159	946	935	935
query36	1294	1063	1326	1063
query37	92	64	61	61
query38	3107	3003	2991	2991
query39	1380	1342	1324	1324
query40	206	96	98	96
query41	47	45	45	45
query42	84	86	83	83
query43	827	654	644	644
query44	1123	729	728	728
query45	245	235	235	235
query46	1233	956	992	956
query47	1849	1611	1862	1611
query48	1020	708	704	704
query49	633	381	375	375
query50	878	598	615	598
query51	4762	4644	4770	4644
query52	89	80	91	80
query53	449	325	322	322
query54	2696	2454	2475	2454
query55	91	89	84	84
query56	227	228	218	218
query57	1156	1174	1009	1009
query58	217	217	212	212
query59	4457	4113	3786	3786
query60	214	200	231	200
query61	102	99	97	97
query62	765	509	500	500
query63	503	348	347	347
query64	2585	1545	1408	1408
query65	3642	3581	3587	3581
query66	825	384	395	384
query67	15509	15914	17740	15914
query68	8439	647	649	647
query69	572	356	350	350
query70	1829	1362	1387	1362
query71	399	311	310	310
query72	6559	3541	3535	3535
query73	735	320	315	315
query74	6266	5908	5887	5887
query75	4848	3677	3718	3677
query76	4927	1122	1184	1122
query77	712	250	257	250
query78	12541	12701	12556	12556
query79	13411	649	645	645
query80	874	400	397	397
query81	498	236	235	235
query82	866	98	98	98
query83	195	130	132	130
query84	264	71	73	71
query85	860	343	340	340
query86	327	292	293	292
query87	3264	3038	3073	3038
query88	5971	2313	2308	2308
query89	408	311	278	278
query90	1938	216	208	208
query91	179	145	144	144
query92	56	49	55	49
query93	5530	623	580	580
query94	742	200	208	200
query95	1083	1056	1047	1047
query96	632	326	323	323
query97	6492	6419	6357	6357
query98	203	183	179	179
query99	2858	850	858	850
Total cold run time: 315706 ms
Total hot run time: 205025 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.09 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ebf26f6596d3ea331618b479d637a5dd154002b9, data reload: false

query1	0.02	0.02	0.02
query2	0.08	0.02	0.02
query3	0.24	0.05	0.06
query4	1.77	0.08	0.07
query5	0.53	0.52	0.51
query6	1.23	0.60	0.62
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.49	0.46
query10	0.54	0.54	0.54
query11	0.12	0.08	0.08
query12	0.11	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.79	0.78
query15	0.77	0.76	0.76
query16	0.37	0.36	0.36
query17	1.03	1.03	1.00
query18	0.21	0.28	0.24
query19	1.92	1.87	1.88
query20	0.02	0.00	0.01
query21	15.49	0.56	0.55
query22	2.14	2.32	1.34
query23	16.94	1.10	0.90
query24	7.21	0.71	1.01
query25	0.36	0.14	0.06
query26	0.70	0.15	0.14
query27	0.05	0.04	0.04
query28	6.24	0.78	0.77
query29	12.64	2.21	2.36
query30	0.55	0.50	0.53
query31	2.82	0.38	0.37
query32	3.38	0.50	0.48
query33	3.08	3.08	3.05
query34	15.24	4.80	4.83
query35	4.88	4.82	4.89
query36	1.06	1.03	1.01
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.02	0.01
query43	0.03	0.02	0.02
Total cold run time: 104.1 s
Total hot run time: 30.09 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit ebf26f6596d3ea331618b479d637a5dd154002b9 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@morrySnow
Copy link
Contributor Author

run p0

@morrySnow morrySnow merged commit 6d84ff0 into apache:branch-2.0 Aug 1, 2024
22 of 24 checks passed
@morrySnow morrySnow deleted the 2.0_38012 branch August 1, 2024 10:09
@xiaokang xiaokang mentioned this pull request Aug 3, 2024
Open
@924060929 924060929 mentioned this pull request Sep 25, 2024
Merged
mongo360 pushed a commit to mongo360/doris that referenced this pull request Dec 11, 2024
@morrySnow
[fix](compatibility) type toSql should return lowercase string (apach…
4e66a9d 
…e#38012) (apache#38521)

pick from master apache#38012
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
area/planner Issues or PRs related to the query planner kind/test
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@morrySnow @doris-robot