Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](inverted index) Corrected the issue of no_index_match failure caused by empty data. #38004

Merged
merged 1 commit into from
Jul 18, 2024

Conversation

zzzxl1993
Copy link
Contributor

Proposed changes

#37947

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zzzxl1993
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.82% (8119/21466)
Line Coverage: 29.49% (66546/225692)
Region Coverage: 28.96% (34299/118445)
Branch Coverage: 24.84% (17622/70952)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c1eef7a6c759d3a6d82f5e8afd6795641a783c57_c1eef7a6c759d3a6d82f5e8afd6795641a783c57/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 49527 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c1eef7a6c759d3a6d82f5e8afd6795641a783c57, data reload: false

------ Round 1 ----------------------------------
q1	17688	4381	4383	4381
q2	2079	153	155	153
q3	10286	1872	1931	1872
q4	10395	1237	1348	1237
q5	8664	3825	3880	3825
q6	233	125	148	125
q7	2032	1597	1590	1590
q8	9316	2720	2685	2685
q9	10620	10294	10205	10205
q10	8619	3627	3500	3500
q11	417	240	247	240
q12	466	307	312	307
q13	18391	3950	4009	3950
q14	362	321	330	321
q15	497	472	461	461
q16	658	562	569	562
q17	1132	970	949	949
q18	7458	6860	6814	6814
q19	1773	1660	1601	1601
q20	559	294	304	294
q21	4433	4022	4067	4022
q22	545	441	433	433
Total cold run time: 116623 ms
Total hot run time: 49527 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4315	4348	4298	4298
q2	320	221	227	221
q3	4127	4156	4117	4117
q4	2764	2712	2721	2712
q5	7185	7106	7092	7092
q6	234	122	116	116
q7	3263	2850	2855	2850
q8	4329	4451	4514	4451
q9	16874	16793	16767	16767
q10	4244	4239	4218	4218
q11	759	685	658	658
q12	1018	856	863	856
q13	6888	3687	3716	3687
q14	465	417	430	417
q15	505	452	447	447
q16	739	677	674	674
q17	3896	3795	3806	3795
q18	8749	8870	8856	8856
q19	1701	1732	1648	1648
q20	2394	2165	2119	2119
q21	8332	8387	8344	8344
q22	1092	1008	977	977
Total cold run time: 84193 ms
Total hot run time: 79320 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204064 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c1eef7a6c759d3a6d82f5e8afd6795641a783c57, data reload: false

query1	930	423	379	379
query2	6554	2927	2801	2801
query3	6927	217	203	203
query4	19904	18290	18186	18186
query5	19734	6534	6552	6534
query6	298	209	235	209
query7	4164	301	300	300
query8	441	424	401	401
query9	3103	2665	2604	2604
query10	412	299	302	299
query11	11188	10685	10602	10602
query12	117	79	69	69
query13	5601	672	682	672
query14	18084	13214	13248	13214
query15	358	253	243	243
query16	6468	295	262	262
query17	1720	1463	874	874
query18	2322	417	413	413
query19	209	150	153	150
query20	79	77	85	77
query21	197	101	92	92
query22	5265	5192	5086	5086
query23	32311	32021	31905	31905
query24	6951	6510	6475	6475
query25	519	434	421	421
query26	525	162	160	160
query27	1805	298	304	298
query28	6060	2356	2321	2321
query29	2924	2667	2691	2667
query30	239	166	167	166
query31	899	725	729	725
query32	71	62	65	62
query33	390	246	257	246
query34	838	487	472	472
query35	1117	932	887	887
query36	1276	1151	1142	1142
query37	91	59	62	59
query38	3051	2920	2947	2920
query39	1378	1355	1334	1334
query40	199	89	94	89
query41	46	45	43	43
query42	85	83	87	83
query43	743	728	687	687
query44	1105	726	724	724
query45	249	238	230	230
query46	1230	949	946	946
query47	1831	1651	1688	1651
query48	1017	700	709	700
query49	627	376	381	376
query50	877	631	602	602
query51	4771	4702	4660	4660
query52	95	85	95	85
query53	451	321	326	321
query54	2643	2495	2500	2495
query55	80	87	84	84
query56	228	227	215	215
query57	1155	1057	1041	1041
query58	219	202	208	202
query59	4091	4241	3924	3924
query60	210	192	204	192
query61	93	91	94	91
query62	890	452	474	452
query63	484	341	341	341
query64	2524	1548	1344	1344
query65	3604	3540	3555	3540
query66	789	378	373	373
query67	15615	15009	15836	15009
query68	8726	655	653	653
query69	557	350	362	350
query70	1596	1565	1367	1367
query71	398	310	320	310
query72	6570	3453	3463	3453
query73	734	328	320	320
query74	6318	5844	5875	5844
query75	5270	3745	3733	3733
query76	5418	1139	1141	1139
query77	916	258	254	254
query78	12711	12526	12482	12482
query79	13291	657	637	637
query80	846	413	399	399
query81	490	241	233	233
query82	1171	98	99	98
query83	172	130	131	130
query84	260	69	71	69
query85	761	323	327	323
query86	333	294	298	294
query87	3258	2998	3019	2998
query88	5999	2342	2317	2317
query89	419	292	276	276
query90	1907	222	221	221
query91	183	142	138	138
query92	63	54	53	53
query93	5730	592	570	570
query94	729	217	215	215
query95	1122	1070	1073	1070
query96	635	323	325	323
query97	6484	6340	6335	6335
query98	185	173	169	169
query99	2718	929	861	861
Total cold run time: 316441 ms
Total hot run time: 204064 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.02 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c1eef7a6c759d3a6d82f5e8afd6795641a783c57, data reload: false

query1	0.02	0.03	0.02
query2	0.06	0.03	0.03
query3	0.24	0.04	0.05
query4	1.81	0.07	0.06
query5	0.53	0.52	0.52
query6	1.22	0.62	0.62
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.51	0.50	0.48
query10	0.54	0.54	0.53
query11	0.11	0.08	0.08
query12	0.12	0.09	0.09
query13	0.63	0.61	0.62
query14	0.77	0.78	0.77
query15	0.78	0.76	0.78
query16	0.36	0.37	0.36
query17	1.04	1.01	1.04
query18	0.19	0.26	0.26
query19	1.91	1.84	1.86
query20	0.01	0.01	0.01
query21	15.74	0.55	0.54
query22	2.02	2.28	1.97
query23	17.10	1.14	1.09
query24	4.26	0.64	1.68
query25	0.33	0.08	0.05
query26	0.54	0.17	0.17
query27	0.05	0.05	0.03
query28	9.27	0.74	0.71
query29	12.62	2.33	2.34
query30	0.64	0.54	0.53
query31	2.81	0.38	0.37
query32	3.38	0.50	0.50
query33	3.08	3.09	3.14
query34	15.25	4.79	4.80
query35	4.84	4.83	4.85
query36	1.05	1.01	1.01
query37	0.05	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.01
Total cold run time: 104.24 s
Total hot run time: 31.02 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit c1eef7a6c759d3a6d82f5e8afd6795641a783c57 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       22.0 seconds inserted 10000000 Rows, about 454K ops/s

@xiaokang xiaokang merged commit e41896c into apache:branch-2.0 Jul 18, 2024
23 of 25 checks passed
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants