Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Fix](planner) fix create view star except and modify cast to sql #33726

Merged
merged 4 commits into from
Apr 19, 2024
Merged

[Fix](planner) fix create view star except and modify cast to sql #33726

merged 4 commits into from
Apr 19, 2024

Conversation

feiniaofeiafei
Copy link
Contributor

fix old planner create view bug when the select has star except and cast(sth to time)

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@feiniaofeiafei
Copy link
Contributor Author

run buildall

morrySnow
morrySnow previously approved these changes Apr 16, 2024
View reviewed changes
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 16, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 38691 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d14e24904cf94675fbea061e645883657c1fd0d9, data reload: false

------ Round 1 ----------------------------------
q1	17603	4263	4245	4245
q2	2017	194	196	194
q3	10441	1187	1182	1182
q4	10190	762	745	745
q5	7514	2713	2670	2670
q6	224	131	135	131
q7	1008	634	599	599
q8	9225	2060	2043	2043
q9	7404	6588	6540	6540
q10	8486	3545	3511	3511
q11	437	238	238	238
q12	453	224	222	222
q13	18677	2917	2962	2917
q14	263	234	225	225
q15	529	480	480	480
q16	543	379	386	379
q17	973	687	660	660
q18	7290	6809	6852	6809
q19	8679	1560	1479	1479
q20	629	316	304	304
q21	3597	2871	2810	2810
q22	366	309	308	308
Total cold run time: 116548 ms
Total hot run time: 38691 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4467	4295	4247	4247
q2	375	265	268	265
q3	3009	2721	2839	2721
q4	1860	1543	1556	1543
q5	5361	5355	5334	5334
q6	215	126	128	126
q7	2246	1879	1853	1853
q8	3212	3423	3321	3321
q9	8620	8586	8830	8586
q10	4078	3931	3903	3903
q11	619	501	499	499
q12	814	651	631	631
q13	15984	3231	3232	3231
q14	320	277	294	277
q15	538	492	474	474
q16	487	446	443	443
q17	1834	1571	1529	1529
q18	8056	8151	7861	7861
q19	1676	1558	1621	1558
q20	2048	1891	1860	1860
q21	5209	4944	4956	4944
q22	552	488	481	481
Total cold run time: 71580 ms
Total hot run time: 55687 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185425 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d14e24904cf94675fbea061e645883657c1fd0d9, data reload: false

query1	901	369	378	369
query2	6393	2585	2302	2302
query3	6651	203	199	199
query4	22629	21212	21206	21206
query5	4107	403	419	403
query6	280	202	173	173
query7	4591	284	293	284
query8	235	179	175	175
query9	8459	2345	2331	2331
query10	410	255	267	255
query11	14882	14252	14278	14252
query12	135	90	92	90
query13	1659	357	357	357
query14	9315	7759	7860	7759
query15	264	185	183	183
query16	8198	268	262	262
query17	1925	571	549	549
query18	2105	274	272	272
query19	294	145	149	145
query20	90	87	82	82
query21	206	126	121	121
query22	4953	4805	4786	4786
query23	33564	33037	33179	33037
query24	7656	3091	3095	3091
query25	595	394	380	380
query26	708	159	156	156
query27	2420	355	373	355
query28	5519	2107	2092	2092
query29	916	636	611	611
query30	284	189	176	176
query31	992	751	756	751
query32	91	53	51	51
query33	546	247	244	244
query34	917	489	483	483
query35	814	710	721	710
query36	1048	919	938	919
query37	113	75	72	72
query38	3472	3312	3303	3303
query39	1640	1601	1564	1564
query40	184	132	128	128
query41	45	42	47	42
query42	101	100	97	97
query43	587	550	545	545
query44	1101	735	741	735
query45	298	296	234	234
query46	1093	731	780	731
query47	2028	1955	1926	1926
query48	379	311	307	307
query49	841	379	393	379
query50	788	399	395	395
query51	6918	6717	6725	6717
query52	112	87	91	87
query53	339	274	286	274
query54	261	237	222	222
query55	75	70	74	70
query56	235	237	233	233
query57	1226	1125	1142	1125
query58	231	211	211	211
query59	3444	3071	3010	3010
query60	260	240	245	240
query61	106	106	105	105
query62	577	462	461	461
query63	302	276	277	276
query64	4660	3966	4007	3966
query65	3053	3036	3052	3036
query66	764	358	419	358
query67	15468	15098	15620	15098
query68	5407	534	534	534
query69	520	302	301	301
query70	1235	1146	1146	1146
query71	1385	1273	1261	1261
query72	6735	2576	2466	2466
query73	725	319	319	319
query74	6834	6259	6481	6259
query75	3377	2593	2637	2593
query76	3552	921	1003	921
query77	609	263	263	263
query78	10953	10373	10162	10162
query79	8935	516	510	510
query80	1865	439	429	429
query81	561	244	243	243
query82	1555	98	100	98
query83	243	162	163	162
query84	261	88	82	82
query85	1372	266	256	256
query86	484	295	316	295
query87	3490	3279	3324	3279
query88	5133	2412	2414	2412
query89	562	361	371	361
query90	1889	175	175	175
query91	119	94	94	94
query92	55	47	46	46
query93	7035	508	505	505
query94	1101	175	170	170
query95	385	291	298	291
query96	589	264	264	264
query97	3180	2955	2909	2909
query98	230	228	210	210
query99	1266	851	868	851
Total cold run time: 287095 ms
Total hot run time: 185425 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.65 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d14e24904cf94675fbea061e645883657c1fd0d9, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.04
query4	1.68	0.08	0.09
query5	0.50	0.49	0.52
query6	1.46	0.72	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.54	0.50	0.50
query10	0.54	0.55	0.52
query11	0.15	0.12	0.12
query12	0.14	0.12	0.12
query13	0.61	0.58	0.60
query14	0.75	0.78	0.78
query15	0.83	0.82	0.80
query16	0.36	0.36	0.36
query17	0.96	0.97	1.02
query18	0.23	0.23	0.22
query19	1.77	1.72	1.69
query20	0.02	0.01	0.01
query21	15.58	0.66	0.66
query22	4.16	8.44	1.33
query23	18.36	1.36	1.22
query24	1.58	0.25	0.21
query25	0.14	0.09	0.08
query26	0.26	0.17	0.17
query27	0.08	0.08	0.08
query28	13.55	1.01	0.97
query29	12.61	3.23	3.26
query30	0.25	0.06	0.07
query31	2.85	0.38	0.37
query32	3.29	0.46	0.46
query33	2.82	2.84	2.83
query34	17.12	4.37	4.48
query35	4.47	4.47	4.47
query36	0.63	0.45	0.47
query37	0.17	0.16	0.15
query38	0.16	0.15	0.14
query39	0.05	0.04	0.03
query40	0.19	0.14	0.15
query41	0.10	0.05	0.04
query42	0.06	0.04	0.04
query43	0.04	0.03	0.04
Total cold run time: 109.48 s
Total hot run time: 29.65 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d14e24904cf94675fbea061e645883657c1fd0d9 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.5 seconds inserted 10000000 Rows, about 740K ops/s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38228 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3ec94a3f2f7483ab29b8cc9df6589f4e39b7e630, data reload: false

------ Round 1 ----------------------------------
q1	17609	4276	4192	4192
q2	2010	196	186	186
q3	10464	1162	1210	1162
q4	10183	749	739	739
q5	7531	2652	2641	2641
q6	219	134	132	132
q7	998	616	570	570
q8	9217	2059	2022	2022
q9	7231	6560	6523	6523
q10	8566	3562	3558	3558
q11	490	226	223	223
q12	433	215	208	208
q13	17770	2935	2961	2935
q14	276	228	225	225
q15	518	470	473	470
q16	515	388	378	378
q17	936	633	696	633
q18	7295	6762	6605	6605
q19	4856	1497	1520	1497
q20	642	311	308	308
q21	3350	2720	2784	2720
q22	358	301	302	301
Total cold run time: 111467 ms
Total hot run time: 38228 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4352	4225	4181	4181
q2	380	271	264	264
q3	2964	2716	2752	2716
q4	1833	1573	1604	1573
q5	5314	5284	5265	5265
q6	208	123	120	120
q7	2186	1870	1825	1825
q8	3187	3347	3320	3320
q9	8527	8529	8528	8528
q10	4005	3838	3873	3838
q11	618	549	509	509
q12	775	623	638	623
q13	17599	3249	3219	3219
q14	326	296	288	288
q15	528	490	486	486
q16	488	453	450	450
q17	1783	1499	1534	1499
q18	8014	7919	7967	7919
q19	1647	1569	1550	1550
q20	2014	1863	1836	1836
q21	5050	4854	5034	4854
q22	551	485	476	476
Total cold run time: 72349 ms
Total hot run time: 55339 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185541 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3ec94a3f2f7483ab29b8cc9df6589f4e39b7e630, data reload: false

query1	894	350	349	349
query2	6211	2616	2497	2497
query3	6684	202	207	202
query4	24408	21431	21505	21431
query5	4134	398	409	398
query6	260	180	170	170
query7	4581	284	278	278
query8	224	186	181	181
query9	8495	2394	2393	2393
query10	414	244	250	244
query11	14804	14267	14329	14267
query12	137	94	84	84
query13	1636	372	375	372
query14	11583	7518	7420	7420
query15	255	180	179	179
query16	7908	269	257	257
query17	1918	571	569	569
query18	1344	286	270	270
query19	198	155	154	154
query20	92	84	89	84
query21	202	128	125	125
query22	4981	4838	4792	4792
query23	33783	33122	33491	33122
query24	7201	3034	3026	3026
query25	590	393	375	375
query26	710	158	149	149
query27	2268	360	369	360
query28	4052	2148	2160	2148
query29	859	618	603	603
query30	312	178	185	178
query31	1019	745	776	745
query32	93	49	52	49
query33	479	253	251	251
query34	892	484	490	484
query35	803	701	690	690
query36	1050	924	930	924
query37	113	79	81	79
query38	3461	3326	3345	3326
query39	1630	1580	1573	1573
query40	187	131	123	123
query41	44	43	51	43
query42	106	107	95	95
query43	587	531	552	531
query44	1115	785	736	736
query45	292	269	261	261
query46	1085	720	728	720
query47	2033	1939	1932	1932
query48	387	303	312	303
query49	818	375	402	375
query50	809	415	426	415
query51	6862	6819	6771	6771
query52	99	85	82	82
query53	343	272	269	269
query54	245	219	217	217
query55	76	71	72	71
query56	241	220	216	216
query57	1208	1109	1124	1109
query58	224	192	192	192
query59	3360	3116	3121	3116
query60	250	228	228	228
query61	89	86	85	85
query62	559	438	454	438
query63	308	275	284	275
query64	4707	3832	3856	3832
query65	3105	3026	3045	3026
query66	797	325	321	321
query67	15322	15023	14683	14683
query68	5168	541	543	541
query69	473	290	294	290
query70	1181	1136	1152	1136
query71	1339	1264	1262	1262
query72	6422	2639	2410	2410
query73	699	319	322	319
query74	6857	6457	6496	6457
query75	3322	2610	2619	2610
query76	2740	1018	970	970
query77	394	255	258	255
query78	10902	10253	10231	10231
query79	5379	526	531	526
query80	1890	434	435	434
query81	525	244	242	242
query82	1300	102	92	92
query83	268	169	169	169
query84	268	85	83	83
query85	1684	274	267	267
query86	523	304	290	290
query87	3471	3337	3399	3337
query88	5076	2450	2446	2446
query89	485	369	366	366
query90	1848	177	173	173
query91	119	97	94	94
query92	55	45	47	45
query93	5848	514	506	506
query94	1232	177	180	177
query95	380	291	288	288
query96	601	271	271	271
query97	3111	2946	2910	2910
query98	239	224	218	218
query99	1209	863	870	863
Total cold run time: 280944 ms
Total hot run time: 185541 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.37 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3ec94a3f2f7483ab29b8cc9df6589f4e39b7e630, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.03
query3	0.22	0.04	0.04
query4	1.67	0.08	0.07
query5	0.49	0.49	0.50
query6	1.47	0.73	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.57	0.50	0.49
query10	0.56	0.57	0.55
query11	0.16	0.11	0.12
query12	0.14	0.12	0.13
query13	0.60	0.59	0.59
query14	0.75	0.77	0.78
query15	0.83	0.81	0.80
query16	0.37	0.37	0.38
query17	0.98	0.99	0.99
query18	0.24	0.23	0.24
query19	1.89	1.74	1.76
query20	0.02	0.01	0.01
query21	15.40	0.65	0.65
query22	4.74	7.25	1.85
query23	18.29	1.37	1.23
query24	1.68	0.30	0.24
query25	0.14	0.08	0.08
query26	0.27	0.17	0.17
query27	0.08	0.07	0.09
query28	13.29	0.99	0.98
query29	12.63	3.25	3.27
query30	0.27	0.06	0.07
query31	2.87	0.38	0.37
query32	3.29	0.46	0.45
query33	2.85	2.80	2.80
query34	16.98	4.41	4.49
query35	4.50	4.56	4.50
query36	0.66	0.48	0.46
query37	0.18	0.17	0.15
query38	0.15	0.14	0.14
query39	0.05	0.03	0.04
query40	0.17	0.14	0.16
query41	0.10	0.05	0.05
query42	0.06	0.04	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.84 s
Total hot run time: 30.37 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3ec94a3f2f7483ab29b8cc9df6589f4e39b7e630 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       14.1 seconds inserted 10000000 Rows, about 709K ops/s

@feiniaofeiafei
Copy link
Contributor Author

run p0

@feiniaofeiafei
Copy link
Contributor Author

run feut

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Apr 17, 2024
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38498 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 71aaecd8f60d15b2121902cfd601abb7e1f0bc44, data reload: false

------ Round 1 ----------------------------------
q1	17618	4335	4250	4250
q2	2010	190	181	181
q3	10456	1188	1140	1140
q4	10183	788	791	788
q5	7504	2721	2665	2665
q6	228	133	132	132
q7	1000	619	590	590
q8	9217	2095	2040	2040
q9	7472	6598	6610	6598
q10	8537	3516	3555	3516
q11	444	241	223	223
q12	446	213	210	210
q13	17776	2974	2952	2952
q14	265	231	233	231
q15	525	479	472	472
q16	528	376	378	376
q17	964	699	686	686
q18	7322	6813	6615	6615
q19	7283	1522	1514	1514
q20	660	322	312	312
q21	3438	2701	2872	2701
q22	360	320	306	306
Total cold run time: 114236 ms
Total hot run time: 38498 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4378	4266	4226	4226
q2	368	273	267	267
q3	2978	2764	2754	2754
q4	1884	1614	1533	1533
q5	5306	5286	5330	5286
q6	212	125	125	125
q7	2269	1867	1865	1865
q8	3217	3330	3342	3330
q9	8587	8565	8640	8565
q10	4076	3967	3984	3967
q11	592	494	478	478
q12	788	673	642	642
q13	16554	3227	3119	3119
q14	310	300	283	283
q15	548	480	492	480
q16	511	445	453	445
q17	1818	1552	1501	1501
q18	8095	8071	7816	7816
q19	1660	1595	1580	1580
q20	2043	1857	1825	1825
q21	8897	4940	5024	4940
q22	542	486	473	473
Total cold run time: 75633 ms
Total hot run time: 55500 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184088 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 71aaecd8f60d15b2121902cfd601abb7e1f0bc44, data reload: false

query1	893	380	383	380
query2	6189	2763	2299	2299
query3	6652	204	201	201
query4	24494	21415	21232	21232
query5	4194	406	412	406
query6	274	185	197	185
query7	4583	291	285	285
query8	228	189	181	181
query9	8541	2372	2372	2372
query10	419	245	257	245
query11	14814	14204	14157	14157
query12	138	94	85	85
query13	1637	357	351	351
query14	9427	7628	7382	7382
query15	236	176	189	176
query16	8067	256	273	256
query17	1912	565	543	543
query18	2006	267	263	263
query19	187	146	146	146
query20	90	86	80	80
query21	193	131	121	121
query22	5024	4891	4794	4794
query23	33778	33048	33562	33048
query24	10935	3082	3060	3060
query25	595	393	384	384
query26	711	159	152	152
query27	2470	356	371	356
query28	6122	2080	2088	2080
query29	867	640	631	631
query30	291	184	179	179
query31	1016	755	738	738
query32	95	51	51	51
query33	671	246	247	246
query34	905	500	509	500
query35	848	710	693	693
query36	1078	928	939	928
query37	108	70	72	70
query38	3492	3338	3383	3338
query39	1061	1020	1051	1020
query40	171	129	129	129
query41	52	53	46	46
query42	103	95	100	95
query43	593	550	537	537
query44	1087	747	751	747
query45	301	280	284	280
query46	1125	756	720	720
query47	2035	1973	2013	1973
query48	378	303	323	303
query49	833	389	374	374
query50	781	396	396	396
query51	6835	6728	6850	6728
query52	96	82	88	82
query53	342	268	272	268
query54	296	225	227	225
query55	76	70	69	69
query56	249	221	229	221
query57	1207	1130	1191	1130
query58	212	195	202	195
query59	3530	2979	3203	2979
query60	265	228	235	228
query61	87	89	89	89
query62	588	450	445	445
query63	304	273	273	273
query64	4534	3798	3658	3658
query65	3094	3037	3047	3037
query66	758	338	360	338
query67	15346	14786	14946	14786
query68	5845	528	541	528
query69	527	312	310	310
query70	1190	1121	1126	1121
query71	1439	1263	1265	1263
query72	6684	2635	2429	2429
query73	724	331	321	321
query74	6766	6422	6438	6422
query75	3465	2698	2576	2576
query76	3830	965	961	961
query77	612	255	261	255
query78	10972	10275	10158	10158
query79	4320	504	511	504
query80	1296	431	423	423
query81	509	236	245	236
query82	1544	102	95	95
query83	198	163	167	163
query84	265	89	81	81
query85	1373	275	257	257
query86	463	287	293	287
query87	3501	3305	3314	3305
query88	4986	2494	2512	2494
query89	487	370	382	370
query90	1834	180	186	180
query91	122	96	95	95
query92	56	46	46	46
query93	5402	499	496	496
query94	1134	177	233	177
query95	383	297	297	297
query96	604	272	269	269
query97	3130	2951	2990	2951
query98	228	220	211	211
query99	1206	842	856	842
Total cold run time: 285614 ms
Total hot run time: 184088 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.17 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 71aaecd8f60d15b2121902cfd601abb7e1f0bc44, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.06
query4	1.66	0.09	0.09
query5	0.50	0.51	0.51
query6	1.47	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.50	0.49
query10	0.55	0.55	0.54
query11	0.16	0.12	0.11
query12	0.14	0.12	0.12
query13	0.61	0.58	0.58
query14	0.77	0.77	0.78
query15	0.83	0.81	0.82
query16	0.37	0.36	0.36
query17	0.98	0.96	1.00
query18	0.22	0.22	0.27
query19	1.88	1.72	1.75
query20	0.02	0.01	0.01
query21	15.40	0.66	0.66
query22	4.00	7.50	1.77
query23	18.32	1.32	1.19
query24	1.90	0.24	0.23
query25	0.15	0.08	0.08
query26	0.27	0.17	0.17
query27	0.08	0.07	0.08
query28	13.28	1.00	0.98
query29	12.56	3.24	3.25
query30	0.26	0.06	0.07
query31	2.84	0.37	0.37
query32	3.30	0.47	0.47
query33	2.79	2.88	2.81
query34	17.08	4.41	4.42
query35	4.53	4.47	4.44
query36	0.65	0.46	0.45
query37	0.20	0.15	0.15
query38	0.15	0.15	0.15
query39	0.04	0.03	0.03
query40	0.17	0.13	0.15
query41	0.09	0.06	0.05
query42	0.06	0.04	0.04
query43	0.04	0.03	0.04
Total cold run time: 109.28 s
Total hot run time: 30.17 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 71aaecd8f60d15b2121902cfd601abb7e1f0bc44 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       14.3 seconds inserted 10000000 Rows, about 699K ops/s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38626 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit df5872734a4df04f3a7cb7e020e07ebcd5928d27, data reload: false

------ Round 1 ----------------------------------
q1	17621	4261	4256	4256
q2	2014	191	183	183
q3	10449	1180	1228	1180
q4	10192	724	789	724
q5	7505	2887	2661	2661
q6	216	133	133	133
q7	1016	625	598	598
q8	9231	2084	2026	2026
q9	7486	6578	6542	6542
q10	8585	3515	3527	3515
q11	451	232	231	231
q12	474	222	215	215
q13	17759	2955	2965	2955
q14	273	235	225	225
q15	521	482	478	478
q16	527	377	371	371
q17	970	664	757	664
q18	7356	6745	6796	6745
q19	6773	1524	1553	1524
q20	646	320	309	309
q21	3601	2797	2828	2797
q22	362	294	309	294
Total cold run time: 114028 ms
Total hot run time: 38626 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4367	4245	4246	4245
q2	371	264	275	264
q3	2960	2775	2833	2775
q4	1877	1622	1594	1594
q5	5312	5306	5343	5306
q6	208	124	123	123
q7	2263	1869	1866	1866
q8	3203	3346	3328	3328
q9	8641	8565	8698	8565
q10	4124	3915	4062	3915
q11	594	504	490	490
q12	809	601	625	601
q13	16308	3257	3109	3109
q14	315	309	294	294
q15	524	483	487	483
q16	507	462	471	462
q17	1865	1506	1484	1484
q18	8133	8041	7849	7849
q19	1674	1526	1600	1526
q20	2061	1858	1798	1798
q21	6372	4904	4984	4904
q22	526	491	476	476
Total cold run time: 73014 ms
Total hot run time: 55457 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185256 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit df5872734a4df04f3a7cb7e020e07ebcd5928d27, data reload: false

query1	891	367	360	360
query2	6922	2582	2394	2394
query3	6651	213	214	213
query4	23534	21262	21622	21262
query5	4173	406	405	405
query6	278	180	185	180
query7	4582	280	280	280
query8	235	175	162	162
query9	8507	2324	2330	2324
query10	415	240	262	240
query11	14914	14198	14165	14165
query12	139	88	85	85
query13	1637	369	364	364
query14	9938	7298	7773	7298
query15	250	189	180	180
query16	8184	259	261	259
query17	1930	589	564	564
query18	2096	283	277	277
query19	307	158	156	156
query20	91	86	86	86
query21	199	128	128	128
query22	5089	4875	4937	4875
query23	33764	33043	33451	33043
query24	10810	3053	2954	2954
query25	618	432	408	408
query26	697	160	158	158
query27	2326	362	368	362
query28	6201	2057	2075	2057
query29	895	649	644	644
query30	328	186	179	179
query31	1009	759	782	759
query32	91	54	59	54
query33	726	264	257	257
query34	1050	491	495	491
query35	867	718	720	718
query36	1101	936	943	936
query37	112	69	75	69
query38	3599	3346	3374	3346
query39	1619	1579	1580	1579
query40	186	131	131	131
query41	49	44	46	44
query42	106	96	100	96
query43	603	571	561	561
query44	1224	768	748	748
query45	297	259	274	259
query46	1110	751	737	737
query47	2035	1948	2024	1948
query48	397	307	305	305
query49	863	398	398	398
query50	807	399	405	399
query51	6887	6740	6826	6740
query52	103	83	87	83
query53	345	272	273	272
query54	305	228	220	220
query55	74	72	71	71
query56	246	227	221	221
query57	1223	1140	1106	1106
query58	209	207	198	198
query59	3461	3172	3088	3088
query60	248	232	236	232
query61	93	88	87	87
query62	599	438	431	431
query63	303	274	283	274
query64	4802	3983	3909	3909
query65	3050	3014	3025	3014
query66	753	320	325	320
query67	15856	15251	15084	15084
query68	9281	543	543	543
query69	594	345	303	303
query70	1412	1164	1143	1143
query71	1499	1262	1261	1261
query72	6844	2633	2442	2442
query73	1587	319	314	314
query74	6967	6339	6471	6339
query75	4390	2642	2609	2609
query76	5765	1030	927	927
query77	640	264	267	264
query78	11053	10211	10193	10193
query79	11738	535	524	524
query80	2827	444	434	434
query81	536	235	238	235
query82	245	91	97	91
query83	216	167	164	164
query84	264	85	80	80
query85	958	274	268	268
query86	338	291	303	291
query87	3480	3317	3312	3312
query88	5262	2336	2385	2336
query89	505	375	365	365
query90	2425	182	188	182
query91	122	97	95	95
query92	58	48	47	47
query93	7382	500	488	488
query94	1558	175	178	175
query95	399	294	304	294
query96	608	269	266	266
query97	3140	2935	2990	2935
query98	244	220	231	220
query99	1231	869	881	869
Total cold run time: 306577 ms
Total hot run time: 185256 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.79 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit df5872734a4df04f3a7cb7e020e07ebcd5928d27, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.03	0.04
query3	0.23	0.04	0.05
query4	1.67	0.07	0.08
query5	0.50	0.49	0.49
query6	1.46	0.72	0.71
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.50	0.50
query10	0.53	0.57	0.55
query11	0.15	0.11	0.10
query12	0.14	0.11	0.12
query13	0.60	0.58	0.59
query14	0.77	0.78	0.78
query15	0.82	0.80	0.80
query16	0.36	0.37	0.38
query17	1.00	1.00	1.00
query18	0.21	0.24	0.23
query19	1.86	1.77	1.69
query20	0.02	0.01	0.01
query21	15.41	0.65	0.64
query22	3.93	7.13	2.35
query23	18.31	1.33	1.26
query24	1.60	0.26	0.25
query25	0.14	0.08	0.09
query26	0.27	0.15	0.16
query27	0.08	0.07	0.08
query28	13.38	0.99	0.97
query29	12.58	3.39	3.31
query30	0.25	0.06	0.05
query31	2.84	0.37	0.37
query32	3.30	0.47	0.46
query33	2.80	2.81	2.79
query34	17.24	4.43	4.40
query35	4.46	4.52	4.45
query36	0.64	0.46	0.49
query37	0.18	0.16	0.15
query38	0.14	0.14	0.14
query39	0.05	0.03	0.04
query40	0.17	0.15	0.14
query41	0.09	0.05	0.05
query42	0.08	0.04	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.04 s
Total hot run time: 30.79 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit df5872734a4df04f3a7cb7e020e07ebcd5928d27 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.5 seconds inserted 10000000 Rows, about 740K ops/s

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 19, 2024
@starocean999 starocean999 merged commit c6b7667 into apache:master Apr 19, 2024
26 of 29 checks passed
yiguolei pushed a commit that referenced this pull request Apr 19, 2024
@feiniaofeiafei @Doris-Extras
[Fix](planner) fix create view star except and modify cast to sql (#3…
6776a3a 
…3726)
dataroaring pushed a commit that referenced this pull request Apr 24, 2024
@feiniaofeiafei @dataroaring
[Fix](planner) fix create view star except and modify cast to sql (#3…
a72b027 
…3726)
feiniaofeiafei added a commit to feiniaofeiafei/doris that referenced this pull request May 24, 2024
@feiniaofeiafei
[Fix](planner) fix create view star except and modify cast to sql (ap…
2c331f4 
…ache#33726)
@feiniaofeiafei feiniaofeiafei mentioned this pull request May 24, 2024
Merged
feiniaofeiafei added a commit to feiniaofeiafei/doris that referenced this pull request May 24, 2024
@feiniaofeiafei
[Fix](planner) fix create view star except and modify cast to sql (ap…
97055c7 
…ache#33726)
feiniaofeiafei added a commit to feiniaofeiafei/doris that referenced this pull request May 24, 2024
@feiniaofeiafei
[Fix](planner) fix create view star except and modify cast to sql (ap…
01c06f3 
…ache#33726)
feiniaofeiafei added a commit to feiniaofeiafei/doris that referenced this pull request May 27, 2024
@feiniaofeiafei
[Fix](planner) fix create view star except and modify cast to sql (ap…
a07c169 
…ache#33726)
morrySnow added a commit that referenced this pull request May 27, 2024
@feiniaofeiafei @morrySnow
[Fix](planner) fix create view star except and modify cast to sql (#3…
b1a15f9 
…5324)

cherry-pick #25951 to branch-2.0
cherry-pick #33726 to branch-2.0

---------

Co-authored-by: morrySnow <101034200+morrySnow@users.noreply.github.com>
Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
@feiniaofeiafei feiniaofeiafei mentioned this pull request Jul 4, 2024
Merged
morrySnow pushed a commit that referenced this pull request Jul 5, 2024
@feiniaofeiafei
[fix](planner) fix bug of select stmt toSql (#37274)
40355ab 
PR #33726 does not correctly fix the create view problem of the legacy
optimizer caused by the toSql bug (* except syntax). The results of the
regression test cases are also problematic. This pr fix the problem.

---------

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
feiniaofeiafei added a commit to feiniaofeiafei/doris that referenced this pull request Jul 5, 2024
@feiniaofeiafei
[fix](planner) fix bug of select stmt toSql (apache#37274)
7d61d93 
PR apache#33726 does not correctly fix the create view problem of the legacy
optimizer caused by the toSql bug (* except syntax). The results of the
regression test cases are also problematic. This pr fix the problem.

---------

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
dataroaring pushed a commit that referenced this pull request Jul 17, 2024
@feiniaofeiafei @dataroaring
[fix](planner) fix bug of select stmt toSql (#37274)
25b179b 
PR #33726 does not correctly fix the create view problem of the legacy
optimizer caused by the toSql bug (* except syntax). The results of the
regression test cases are also problematic. This pr fix the problem.

---------

Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@feiniaofeiafei @morrySnow
[Fix](planner) fix create view star except and modify cast to sql (ap…
a4705e6 
…ache#35324)

cherry-pick apache#25951 to branch-2.0
cherry-pick apache#33726 to branch-2.0

---------

Co-authored-by: morrySnow <101034200+morrySnow@users.noreply.github.com>
Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@starocean999 starocean999 starocean999 approved these changes

@924060929 924060929 924060929 approved these changes

@morrySnow morrySnow morrySnow left review comments

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.11-merged dev/2.1.3-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@feiniaofeiafei @doris-robot @924060929 @starocean999 @morrySnow