Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](multicatalog) make lastdbofcatalog a session variable #37828

Merged
merged 7 commits into from
Jul 23, 2024

Conversation

Yulei-Yang
Copy link
Contributor

bring by: #14793

issue:
lastdbofcatalog is a global variable, so all login user share it. that's not correct, should be a session variable

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@Yulei-Yang
Copy link
Contributor Author

run buildall

@morningman morningman self-assigned this Jul 15, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 39287 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 444242013ad74e09785fba98e9c758014e679a9a, data reload: false

------ Round 1 ----------------------------------
q1	17622	4307	4260	4260
q2	2017	191	183	183
q3	10459	1165	1009	1009
q4	10180	762	837	762
q5	7564	2665	2660	2660
q6	226	137	135	135
q7	952	591	595	591
q8	9231	2054	2104	2054
q9	8725	6526	6491	6491
q10	8893	3795	3732	3732
q11	451	253	231	231
q12	466	221	218	218
q13	18059	2957	3007	2957
q14	272	233	238	233
q15	513	472	483	472
q16	503	379	378	378
q17	963	593	644	593
q18	7998	7357	7467	7357
q19	7343	1452	1283	1283
q20	665	326	328	326
q21	4843	3082	3170	3082
q22	329	280	280	280
Total cold run time: 118274 ms
Total hot run time: 39287 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4364	4273	4295	4273
q2	375	259	266	259
q3	2980	2863	2849	2849
q4	2036	1648	1657	1648
q5	5660	5491	5462	5462
q6	237	132	132	132
q7	2197	1862	1836	1836
q8	3286	3384	3419	3384
q9	8733	8654	8901	8654
q10	4005	3893	3730	3730
q11	572	499	506	499
q12	794	636	644	636
q13	16041	3164	3167	3164
q14	327	273	281	273
q15	515	481	494	481
q16	466	449	435	435
q17	1789	1515	1486	1486
q18	7960	7759	7640	7640
q19	1693	1610	1634	1610
q20	2199	1884	1879	1879
q21	4930	4878	4840	4840
q22	569	485	490	485
Total cold run time: 71728 ms
Total hot run time: 55655 ms

@@ -5381,11 +5381,11 @@ public void changeCatalog(ConnectContext ctx, String catalogName) throws DdlExce
if (StringUtils.isNotEmpty(currentDB)) {
// When dropped the current catalog in current context, the current catalog will be null.
if (ctx.getCurrentCatalog() != null) {
catalogMgr.addLastDBOfCatalog(ctx.getCurrentCatalog().getName(), currentDB);
ConnectContext.get().addLastDBOfCatalog(ctx.getCurrentCatalog().getName(), currentDB);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
ConnectContext.get().addLastDBOfCatalog(ctx.getCurrentCatalog().getName(), currentDB);
ctx.addLastDBOfCatalog(ctx.getCurrentCatalog().getName(), currentDB);

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

}
}
ctx.changeDefaultCatalog(catalogName);
String lastDb = catalogMgr.getLastDB(catalogName);
String lastDb = ConnectContext.get().getLastDBOfCatalog(catalogName);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
String lastDb = ConnectContext.get().getLastDBOfCatalog(catalogName);
String lastDb = ctx.getLastDBOfCatalog(catalogName);

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@@ -140,7 +138,7 @@ private CatalogIf removeCatalog(long catalogId) {
if (catalog != null) {
catalog.onClose();
nameToCatalog.remove(catalog.getName());
lastDBOfCatalog.remove(catalog.getName());
ConnectContext.get().removeLastDBOfCatalog(catalog.getName());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to check whether ConnectContext.get() is null.
Sometimes this operation is not within a connection session.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@@ -282,7 +272,7 @@ public void dropCatalog(DropCatalogStmt stmt) throws UserException {
replayDropCatalog(log);
Env.getCurrentEnv().getEditLog().logCatalogLog(OperationType.OP_DROP_CATALOG, log);

lastDBOfCatalog.remove(stmt.getCatalogName());
ConnectContext.get().removeLastDBOfCatalog(stmt.getCatalogName());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

check null

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@doris-robot
Copy link

TPC-DS: Total hot run time: 172221 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 444242013ad74e09785fba98e9c758014e679a9a, data reload: false

query1	914	362	372	362
query2	6474	2008	1954	1954
query3	6640	210	217	210
query4	28418	17558	17402	17402
query5	3630	469	496	469
query6	264	176	168	168
query7	4556	288	284	284
query8	253	193	191	191
query9	8310	2346	2332	2332
query10	436	278	282	278
query11	12604	10037	10143	10037
query12	116	87	83	83
query13	1613	365	360	360
query14	10273	6966	6820	6820
query15	223	167	162	162
query16	7635	309	301	301
query17	1695	546	507	507
query18	1635	276	266	266
query19	192	163	144	144
query20	86	78	81	78
query21	204	137	126	126
query22	4251	4086	4069	4069
query23	33846	33389	33393	33389
query24	10190	2964	2925	2925
query25	613	373	408	373
query26	700	146	154	146
query27	2313	270	273	270
query28	6029	2041	2018	2018
query29	916	623	670	623
query30	261	148	148	148
query31	966	785	760	760
query32	100	53	57	53
query33	636	303	297	297
query34	908	494	489	489
query35	682	580	574	574
query36	1123	981	975	975
query37	146	84	82	82
query38	2983	2932	2865	2865
query39	898	874	838	838
query40	204	118	117	117
query41	44	45	43	43
query42	117	100	93	93
query43	510	474	474	474
query44	1085	709	734	709
query45	196	164	161	161
query46	1079	719	717	717
query47	1865	1772	1799	1772
query48	366	294	288	288
query49	832	398	435	398
query50	778	383	390	383
query51	6888	6814	6766	6766
query52	115	91	93	91
query53	352	276	276	276
query54	839	436	435	435
query55	74	76	71	71
query56	277	257	264	257
query57	1127	1053	1048	1048
query58	250	246	241	241
query59	2872	2834	2857	2834
query60	286	279	269	269
query61	96	93	95	93
query62	798	618	643	618
query63	315	281	279	279
query64	9100	2222	1629	1629
query65	3135	3083	3079	3079
query66	738	325	347	325
query67	15691	15071	14937	14937
query68	4568	522	522	522
query69	592	386	348	348
query70	1198	1155	1095	1095
query71	385	290	275	275
query72	7441	5224	5379	5224
query73	735	319	314	314
query74	6156	5679	5744	5679
query75	3406	2658	2672	2658
query76	2158	916	967	916
query77	560	297	302	297
query78	9489	8946	9553	8946
query79	2153	510	524	510
query80	2346	472	459	459
query81	579	226	221	221
query82	1276	128	130	128
query83	297	162	165	162
query84	252	94	84	84
query85	1388	313	294	294
query86	471	313	324	313
query87	3296	3089	3110	3089
query88	3687	2429	2432	2429
query89	454	381	376	376
query90	1768	192	189	189
query91	125	96	97	96
query92	59	56	50	50
query93	2064	488	489	488
query94	1150	219	215	215
query95	405	316	318	316
query96	603	271	274	271
query97	3206	2980	3045	2980
query98	215	204	202	202
query99	1495	1251	1244	1244
Total cold run time: 277738 ms
Total hot run time: 172221 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.96 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 444242013ad74e09785fba98e9c758014e679a9a, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.22	0.05	0.05
query4	1.68	0.10	0.08
query5	0.50	0.49	0.48
query6	1.14	0.73	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.55	0.49	0.48
query10	0.55	0.54	0.54
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.59	0.59	0.59
query14	0.76	0.78	0.82
query15	0.85	0.81	0.82
query16	0.36	0.37	0.36
query17	0.95	0.99	0.98
query18	0.23	0.21	0.21
query19	1.86	1.65	1.67
query20	0.01	0.00	0.00
query21	15.41	0.76	0.64
query22	4.23	5.65	2.46
query23	18.34	1.40	1.28
query24	2.07	0.22	0.23
query25	0.15	0.09	0.08
query26	0.29	0.21	0.21
query27	0.46	0.23	0.22
query28	13.31	1.04	0.99
query29	13.09	3.26	3.31
query30	0.25	0.06	0.06
query31	2.87	0.39	0.38
query32	3.25	0.47	0.47
query33	2.89	2.87	2.91
query34	17.07	4.31	4.38
query35	4.45	4.40	4.47
query36	0.66	0.46	0.48
query37	0.18	0.15	0.16
query38	0.15	0.15	0.16
query39	0.04	0.04	0.03
query40	0.16	0.12	0.13
query41	0.10	0.05	0.05
query42	0.05	0.04	0.05
query43	0.04	0.04	0.04
Total cold run time: 110.25 s
Total hot run time: 30.96 s

Copy link
Contributor

@morrySnow morrySnow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add a case, connect->switch catalog1->use db1->disconnect->connect->switch catalog1->select one table from db1. should thrown no db selected exception

@Yulei-Yang
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39900 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7e039d3a0528e00ef0e6162b9f966d41616f09d1, data reload: false

------ Round 1 ----------------------------------
q1	17614	4387	4272	4272
q2	2026	195	189	189
q3	10460	1188	1161	1161
q4	10195	756	859	756
q5	7681	2757	2820	2757
q6	248	142	138	138
q7	984	616	610	610
q8	9289	2096	2096	2096
q9	8870	6487	6527	6487
q10	8669	3768	3756	3756
q11	457	242	244	242
q12	399	229	223	223
q13	17925	2982	2981	2981
q14	281	237	231	231
q15	520	493	493	493
q16	491	393	380	380
q17	977	667	659	659
q18	8135	7477	7300	7300
q19	2975	1325	1426	1325
q20	698	315	333	315
q21	4916	3244	3305	3244
q22	349	288	285	285
Total cold run time: 114159 ms
Total hot run time: 39900 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4332	4193	4267	4193
q2	379	271	266	266
q3	2998	2781	2751	2751
q4	1875	1583	1587	1583
q5	5301	5298	5298	5298
q6	216	129	132	129
q7	2101	1738	1770	1738
q8	3201	3350	3295	3295
q9	8421	8373	8357	8357
q10	3886	3707	3763	3707
q11	580	487	484	484
q12	772	608	618	608
q13	17462	2975	2976	2975
q14	311	262	273	262
q15	522	465	474	465
q16	474	413	430	413
q17	1780	1468	1487	1468
q18	7728	7606	7366	7366
q19	5944	1472	1502	1472
q20	2006	1786	1741	1741
q21	4876	4624	4776	4624
q22	579	493	495	493
Total cold run time: 75744 ms
Total hot run time: 53688 ms

morrySnow
morrySnow previously approved these changes Jul 18, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Jul 18, 2024
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-DS: Total hot run time: 173118 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7e039d3a0528e00ef0e6162b9f966d41616f09d1, data reload: false

query1	913	368	365	365
query2	6464	1849	1884	1849
query3	6672	210	213	210
query4	23184	17566	17489	17489
query5	4230	460	471	460
query6	268	174	156	156
query7	4604	282	295	282
query8	250	199	198	198
query9	8621	2516	2495	2495
query10	448	279	296	279
query11	10636	10062	10108	10062
query12	126	81	91	81
query13	1637	367	369	367
query14	9404	7687	6984	6984
query15	218	171	167	167
query16	7817	317	348	317
query17	1773	561	534	534
query18	1952	290	293	290
query19	203	162	154	154
query20	92	84	89	84
query21	212	127	129	127
query22	4307	4131	4036	4036
query23	33618	33121	33299	33121
query24	12179	2863	2920	2863
query25	685	385	389	385
query26	1802	151	152	151
query27	2911	277	277	277
query28	7682	2055	2041	2041
query29	1176	653	624	624
query30	271	150	149	149
query31	977	715	735	715
query32	96	52	55	52
query33	782	324	310	310
query34	943	480	499	480
query35	695	607	585	585
query36	1089	943	948	943
query37	283	80	81	80
query38	2866	2819	2725	2725
query39	868	799	836	799
query40	285	124	120	120
query41	50	47	48	47
query42	114	101	101	101
query43	528	483	467	467
query44	1217	744	732	732
query45	197	165	165	165
query46	1086	739	748	739
query47	1877	1785	1812	1785
query48	375	306	311	306
query49	1180	426	425	425
query50	788	402	406	402
query51	6894	6893	6818	6818
query52	101	92	94	92
query53	357	294	297	294
query54	1000	464	462	462
query55	75	74	74	74
query56	307	291	290	290
query57	1144	1075	1089	1075
query58	267	360	260	260
query59	2924	2855	2919	2855
query60	305	287	280	280
query61	95	105	92	92
query62	808	647	627	627
query63	323	287	289	287
query64	10467	2249	1610	1610
query65	3171	3106	3109	3106
query66	1405	340	332	332
query67	15683	14938	15126	14938
query68	8472	553	563	553
query69	748	467	360	360
query70	1141	1127	1113	1113
query71	518	285	281	281
query72	8635	5651	6146	5651
query73	871	325	329	325
query74	6298	5578	5673	5578
query75	4607	2679	2673	2673
query76	4897	997	1016	997
query77	721	300	293	293
query78	9709	9128	8902	8902
query79	7945	524	532	524
query80	2535	469	480	469
query81	591	219	225	219
query82	788	142	138	138
query83	287	165	164	164
query84	273	86	85	85
query85	1381	331	337	331
query86	423	305	305	305
query87	3278	3131	3116	3116
query88	5211	2470	2465	2465
query89	510	378	368	368
query90	1987	191	191	191
query91	133	98	100	98
query92	64	49	50	49
query93	6000	529	520	520
query94	1249	216	218	216
query95	408	326	319	319
query96	606	276	274	274
query97	3211	3024	3059	3024
query98	217	198	189	189
query99	1582	1261	1283	1261
Total cold run time: 301273 ms
Total hot run time: 173118 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.09 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7e039d3a0528e00ef0e6162b9f966d41616f09d1, data reload: false

query1	0.05	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.08	0.07
query5	0.49	0.48	0.47
query6	1.13	0.74	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.49	0.49
query10	0.54	0.55	0.55
query11	0.16	0.11	0.12
query12	0.15	0.11	0.13
query13	0.63	0.59	0.58
query14	0.75	0.77	0.77
query15	0.86	0.82	0.82
query16	0.37	0.36	0.37
query17	0.97	1.03	0.97
query18	0.22	0.22	0.22
query19	1.82	1.68	1.75
query20	0.01	0.01	0.03
query21	15.40	0.75	0.65
query22	4.97	5.98	2.48
query23	18.33	1.43	1.22
query24	2.11	0.23	0.22
query25	0.15	0.09	0.09
query26	0.30	0.21	0.21
query27	0.46	0.23	0.24
query28	13.29	1.01	1.00
query29	12.59	3.29	3.27
query30	0.25	0.06	0.05
query31	2.86	0.40	0.39
query32	3.29	0.48	0.48
query33	2.87	2.91	2.89
query34	17.20	4.34	4.34
query35	4.43	4.42	4.44
query36	0.65	0.48	0.46
query37	0.18	0.16	0.15
query38	0.16	0.14	0.15
query39	0.04	0.04	0.04
query40	0.16	0.12	0.12
query41	0.10	0.05	0.05
query42	0.07	0.05	0.06
query43	0.05	0.05	0.04
Total cold run time: 110.64 s
Total hot run time: 31.09 s

@Yulei-Yang
Copy link
Contributor Author

run external

@Yulei-Yang
Copy link
Contributor Author

run cloud_p0

def result1 = connect(user=user, password="${pwd}", url=context.config.jdbcUrl) {
sql """switch hms;"""
try {
sql """show tables;"""
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should add assertTrue(false) here.
Otherwise, if show tables run successfully, there is no check

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good catch! fixed

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe

test {
    sql "show tables"
    exception "No database selected"
}

is better

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tks, done

@Yulei-Yang
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40013 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit db9a0ca002f78d5d6f47d26d5ecc0c6180ea3d7c, data reload: false

------ Round 1 ----------------------------------
q1	17595	4361	4321	4321
q2	2019	195	192	192
q3	10455	1199	1174	1174
q4	10192	824	739	739
q5	7585	2663	2682	2663
q6	218	138	137	137
q7	951	596	596	596
q8	9229	2064	2074	2064
q9	8864	6574	6557	6557
q10	8747	3832	3830	3830
q11	467	238	241	238
q12	421	235	228	228
q13	17758	2977	2985	2977
q14	293	235	233	233
q15	529	476	480	476
q16	485	375	371	371
q17	954	610	708	610
q18	8041	7485	7483	7483
q19	4983	1581	1370	1370
q20	669	323	324	323
q21	5031	3200	3157	3157
q22	346	289	274	274
Total cold run time: 115832 ms
Total hot run time: 40013 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4358	4299	4260	4260
q2	368	271	286	271
q3	3020	2813	2911	2813
q4	1981	1727	1696	1696
q5	5691	5571	5583	5571
q6	223	142	136	136
q7	2170	1814	1898	1814
q8	3265	3414	3471	3414
q9	8839	8844	8924	8844
q10	4124	3930	3827	3827
q11	594	484	510	484
q12	805	620	660	620
q13	17312	3208	3186	3186
q14	340	301	301	301
q15	524	482	496	482
q16	500	438	428	428
q17	1856	1525	1515	1515
q18	8032	7974	7876	7876
q19	4373	1617	1599	1599
q20	2127	1890	1861	1861
q21	9297	4882	4869	4869
q22	585	523	494	494
Total cold run time: 80384 ms
Total hot run time: 56361 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174630 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit db9a0ca002f78d5d6f47d26d5ecc0c6180ea3d7c, data reload: false

query1	918	375	369	369
query2	6424	1886	1777	1777
query3	6659	213	217	213
query4	27733	17353	17310	17310
query5	3686	485	484	484
query6	280	181	174	174
query7	4581	289	281	281
query8	245	189	192	189
query9	8737	2406	2383	2383
query10	432	281	279	279
query11	12477	10173	10259	10173
query12	116	84	83	83
query13	1658	367	364	364
query14	10845	7734	7782	7734
query15	230	172	171	171
query16	7564	507	498	498
query17	1589	573	542	542
query18	1649	282	285	282
query19	200	160	162	160
query20	92	87	86	86
query21	213	133	128	128
query22	4719	4472	4137	4137
query23	34508	33754	33905	33754
query24	10945	2966	3013	2966
query25	613	415	439	415
query26	707	155	158	155
query27	2300	279	282	279
query28	6364	2096	2048	2048
query29	918	667	728	667
query30	247	161	153	153
query31	976	771	780	771
query32	99	57	58	57
query33	720	347	342	342
query34	933	493	511	493
query35	874	771	766	766
query36	1163	981	960	960
query37	136	79	80	79
query38	2837	2797	2791	2791
query39	871	809	838	809
query40	205	117	118	117
query41	45	44	45	44
query42	120	98	93	93
query43	495	458	461	458
query44	1152	727	721	721
query45	195	163	162	162
query46	1102	748	743	743
query47	1858	1786	1818	1786
query48	370	294	296	294
query49	816	412	411	411
query50	777	392	390	390
query51	6901	6821	6910	6821
query52	105	92	90	90
query53	365	296	294	294
query54	874	447	439	439
query55	74	73	74	73
query56	298	262	296	262
query57	1143	1051	1074	1051
query58	239	260	268	260
query59	2734	2564	2507	2507
query60	300	277	286	277
query61	116	99	98	98
query62	789	632	651	632
query63	315	286	285	285
query64	9165	2207	1662	1662
query65	3157	3130	3175	3130
query66	722	323	327	323
query67	15744	15118	15108	15108
query68	5412	535	530	530
query69	684	422	371	371
query70	1210	1116	1044	1044
query71	509	272	274	272
query72	9124	5438	5872	5438
query73	759	324	323	323
query74	6097	5698	5674	5674
query75	4426	2751	2781	2751
query76	4067	942	873	873
query77	694	315	314	314
query78	9965	9018	9302	9018
query79	4291	518	508	508
query80	2293	491	475	475
query81	594	218	223	218
query82	1491	138	132	132
query83	321	172	175	172
query84	280	88	89	88
query85	1456	307	296	296
query86	451	286	320	286
query87	3379	3100	3079	3079
query88	5005	2394	2362	2362
query89	495	398	381	381
query90	1942	188	193	188
query91	128	98	100	98
query92	57	51	50	50
query93	5098	510	500	500
query94	1306	275	274	274
query95	404	312	321	312
query96	629	271	270	270
query97	3242	3029	3055	3029
query98	231	198	192	192
query99	1542	1264	1259	1259
Total cold run time: 294016 ms
Total hot run time: 174630 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.36 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit db9a0ca002f78d5d6f47d26d5ecc0c6180ea3d7c, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.06	0.05
query4	1.68	0.08	0.08
query5	0.49	0.49	0.49
query6	1.13	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.50	0.49
query10	0.56	0.56	0.54
query11	0.15	0.12	0.12
query12	0.14	0.12	0.13
query13	0.58	0.59	0.58
query14	0.75	0.79	0.77
query15	0.87	0.82	0.81
query16	0.37	0.37	0.37
query17	1.03	1.04	1.02
query18	0.24	0.23	0.22
query19	1.80	1.72	1.78
query20	0.01	0.01	0.01
query21	15.39	0.74	0.66
query22	4.20	7.76	1.51
query23	18.24	1.38	1.30
query24	2.09	0.23	0.22
query25	0.16	0.09	0.09
query26	0.28	0.21	0.21
query27	0.45	0.23	0.23
query28	13.38	1.03	0.99
query29	12.65	3.33	3.27
query30	0.25	0.06	0.05
query31	2.87	0.39	0.39
query32	3.27	0.48	0.47
query33	2.86	2.90	2.93
query34	17.36	4.36	4.43
query35	4.39	4.40	4.50
query36	0.65	0.48	0.48
query37	0.19	0.17	0.16
query38	0.15	0.15	0.15
query39	0.04	0.04	0.04
query40	0.15	0.13	0.12
query41	0.09	0.05	0.05
query42	0.05	0.04	0.05
query43	0.05	0.05	0.04
Total cold run time: 109.97 s
Total hot run time: 30.36 s

@Yulei-Yang
Copy link
Contributor Author

run p0

2 similar comments
@Yulei-Yang
Copy link
Contributor Author

run p0

@Yulei-Yang
Copy link
Contributor Author

run p0

@Yulei-Yang
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39838 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 17974e35eda4cc33cf15e0f817ebfcaa53bb3e4f, data reload: false

------ Round 1 ----------------------------------
q1	17613	4287	4271	4271
q2	2021	188	183	183
q3	10478	1188	1102	1102
q4	10189	847	796	796
q5	7536	2685	2650	2650
q6	217	136	137	136
q7	956	591	602	591
q8	9223	2047	2086	2047
q9	8826	6529	6589	6529
q10	8653	3736	3745	3736
q11	455	251	241	241
q12	483	230	232	230
q13	17764	2984	2999	2984
q14	272	245	251	245
q15	539	475	479	475
q16	496	383	379	379
q17	957	660	657	657
q18	7915	7384	7366	7366
q19	4938	1460	1451	1451
q20	672	321	325	321
q21	4893	3173	3209	3173
q22	351	275	290	275
Total cold run time: 115447 ms
Total hot run time: 39838 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4350	4216	4193	4193
q2	381	276	268	268
q3	3025	2785	2865	2785
q4	1971	1687	1721	1687
q5	5614	5564	5527	5527
q6	224	133	135	133
q7	2150	1829	1847	1829
q8	3280	3422	3402	3402
q9	8786	8773	8901	8773
q10	4081	3899	3828	3828
q11	592	503	500	500
q12	805	635	630	630
q13	17365	3202	3239	3202
q14	343	281	302	281
q15	530	474	499	474
q16	517	444	432	432
q17	1801	1532	1555	1532
q18	8151	8032	7727	7727
q19	1762	1664	1661	1661
q20	2264	1891	1850	1850
q21	5112	4975	4799	4799
q22	598	514	507	507
Total cold run time: 73702 ms
Total hot run time: 56020 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173323 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 17974e35eda4cc33cf15e0f817ebfcaa53bb3e4f, data reload: false

query1	911	371	360	360
query2	6443	1901	1836	1836
query3	6646	212	220	212
query4	27887	17488	17172	17172
query5	3613	484	490	484
query6	287	191	165	165
query7	4577	289	293	289
query8	242	208	217	208
query9	8455	2444	2423	2423
query10	423	290	276	276
query11	12015	10027	10084	10027
query12	121	82	83	82
query13	1652	368	361	361
query14	10370	7885	7384	7384
query15	222	167	168	167
query16	7171	461	455	455
query17	1153	540	528	528
query18	1803	273	279	273
query19	210	147	164	147
query20	98	94	87	87
query21	202	128	127	127
query22	4236	4156	3989	3989
query23	34105	33938	33587	33587
query24	10253	2935	2953	2935
query25	595	425	382	382
query26	696	161	161	161
query27	2293	280	280	280
query28	6319	2089	2056	2056
query29	893	651	645	645
query30	249	159	156	156
query31	981	760	774	760
query32	100	57	58	57
query33	691	359	362	359
query34	923	507	500	500
query35	864	765	782	765
query36	1140	981	978	978
query37	145	82	79	79
query38	2970	2783	2863	2783
query39	953	839	834	834
query40	208	124	122	122
query41	47	44	43	43
query42	127	101	100	100
query43	501	460	450	450
query44	1071	753	734	734
query45	189	161	160	160
query46	1089	729	758	729
query47	1866	1766	1789	1766
query48	356	292	283	283
query49	827	435	443	435
query50	773	418	391	391
query51	6896	6838	6694	6694
query52	113	90	99	90
query53	357	299	299	299
query54	884	445	447	445
query55	74	76	73	73
query56	311	277	293	277
query57	1163	1048	1054	1048
query58	248	250	252	250
query59	2833	2706	2652	2652
query60	308	279	281	279
query61	100	94	97	94
query62	781	645	650	645
query63	328	300	304	300
query64	9111	2304	1670	1670
query65	3263	3145	3100	3100
query66	763	337	329	329
query67	15363	14810	14774	14774
query68	4511	530	542	530
query69	556	435	360	360
query70	1100	1146	1162	1146
query71	383	289	287	287
query72	7454	5549	5369	5369
query73	748	320	321	320
query74	6260	5670	5633	5633
query75	3408	2697	2705	2697
query76	2126	857	975	857
query77	609	318	317	317
query78	10132	8964	8921	8921
query79	2309	528	527	527
query80	1299	481	489	481
query81	593	224	223	223
query82	966	143	141	141
query83	284	165	164	164
query84	241	93	87	87
query85	1441	333	310	310
query86	463	328	302	302
query87	3291	3102	3097	3097
query88	3822	2361	2376	2361
query89	482	401	407	401
query90	1735	202	198	198
query91	125	102	101	101
query92	62	49	51	49
query93	2294	507	508	507
query94	1179	295	291	291
query95	407	317	322	317
query96	590	279	275	275
query97	3220	2997	3049	2997
query98	218	208	195	195
query99	1531	1263	1261	1261
Total cold run time: 276696 ms
Total hot run time: 173323 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 17974e35eda4cc33cf15e0f817ebfcaa53bb3e4f, data reload: false

query1	0.04	0.04	0.04
query2	0.09	0.04	0.03
query3	0.22	0.05	0.06
query4	1.67	0.08	0.08
query5	0.50	0.48	0.49
query6	1.14	0.72	0.72
query7	0.01	0.01	0.02
query8	0.05	0.04	0.04
query9	0.55	0.49	0.49
query10	0.52	0.54	0.55
query11	0.15	0.12	0.11
query12	0.14	0.12	0.12
query13	0.59	0.59	0.57
query14	0.76	0.77	0.78
query15	0.85	0.82	0.83
query16	0.38	0.37	0.36
query17	1.05	1.05	1.03
query18	0.23	0.22	0.22
query19	1.83	1.74	1.77
query20	0.01	0.00	0.01
query21	15.40	0.76	0.66
query22	4.30	7.25	2.13
query23	18.29	1.33	1.26
query24	2.05	0.22	0.23
query25	0.16	0.08	0.08
query26	0.30	0.21	0.21
query27	0.44	0.22	0.23
query28	13.29	1.02	1.00
query29	12.65	3.27	3.26
query30	0.25	0.06	0.05
query31	2.89	0.39	0.39
query32	3.25	0.48	0.47
query33	2.94	2.92	2.87
query34	16.98	4.31	4.34
query35	4.45	4.40	4.39
query36	0.65	0.50	0.46
query37	0.18	0.16	0.15
query38	0.16	0.14	0.14
query39	0.05	0.03	0.04
query40	0.15	0.12	0.13
query41	0.10	0.05	0.05
query42	0.06	0.04	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.81 s
Total hot run time: 30.77 s

Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 23, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@morningman morningman merged commit 591ddf7 into apache:master Jul 23, 2024
27 of 29 checks passed
@Yulei-Yang Yulei-Yang deleted the fix_lastdbofcatalog_for_master branch July 23, 2024 02:28
dataroaring pushed a commit that referenced this pull request Jul 24, 2024
bring by: #14793

issue:
lastdbofcatalog is a global variable, so all login user share it. that's
not correct, should be a session variable
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants