Release Notes 2.1.3

[yiguolei]

Search before asking

• I had searched in the issues and found no similar issues.

Description

Release Note 2.1.2

Behavior Changed

1. Authorization

   • Grant_priv can no longer be granted arbitrarily. When performing an GRANT operation, the user must not only have Grant_priv, but also have the granted permissions. For example, to grant select permission to table1, the user needs to have both grant permission and select permission.([enhance](auth)when assigning permissions, the current user must have corresponding permissions #32825)

   • Usage_priv for Workload Group and Resource are no longer global-level permissions, but are limited to Resource and Workload Group subjects([fix](auth)unified workload and resource permission logic #32907)

   • Some operations that were not authorized before have been authorized. Currently, all operations will have corresponding authorization.([fix](auth)fix missing authentication #33347)

2. LOG dir config

   • The log dir configuration of FE and BE uses the LOG_DIR environment variable uniformly. All other logs of different types will be stored with LOG_DIR as the root directory. At the same time, in order to maintain compatibility, the previous configuration item sys_log_dir can still be used.([opt](log) refactor the log dir config #32933)

3. S3 Table valued function

   • The parsing logic of the object storage path has been refactored. For the file path in the s3 table valued function, you may need to pass the force_parsing_by_standard_uri parameter to ensure correct parsing. ([Enhancement](multi-catalog) Rewrite S3URI to remove tricky virtual bucket mechanism and support different uri styles by flags. #33858)

Upgrade Problem

1. Let some keyword as non-reserved because many users using some of them as column name or property values. [fix](keyword) let some keyword as non-reserved #34613

New Feature

1. Support INSERT INTO hive table in Hive Catalog.(https://doris.apache.org/docs/lakehouse/datalake-building/hive-build)
2. Add show views statement to query views. [chore](show) support statement to show views from table #32358.
3. Workload group support bind to specific BE hosts. [improvement](executor)Add tag property for workload group #32874.
4. Broker Load spport compressed JSON format. [feature](load) support compressed JSON format data for broker load #30809
5. Truncate function can use column as scale argument. [enhancement](function truncate) truncate can use column as scale argument #32746
6. Add new function uuid_to_int and int_to_uuid. [Feature] support function uuid_to_int and int_to_uuid #33005
7. Support create mtmv based on other mtmv. [enhance](mtmv)support create mtmv with other mtmv #32984.
8. Support rewrite by mv nested materialized view. [nereids](mtmv)Support rewrite by mv nested materialized view #33362
9. Add BypassWorkloadGroup to pass query queue. [Improvement](executor)Add BypassWorkloadGroup to pass query queue #33101.
10. Add function strcmp. [Feature](function) Add function strcmp #33272.
11. Support hll functions hll_from_base64, hll_to_base64. [feature](function) support hll functions hll_from_base64, hll_to_base64 #32089

Optimization

1. Replace SipHash by XXHash to improve shuffle performance. [Function](exec) replace SipHash in function by XXHash #32919
2. MTMV support olap table partition column is null . [enhance](mtmv)support olap table partition column is null #32698.
3. Limit the max string length to 1024 while collecting column stats to control BE memory usage in statistics collection. [improvement](statistics)Limit the max string length to 1024 while collecting column stats to control BE memory usage. #32470.
4. Support dynamic delete bitmap cache to improve the performance. [Enhancement](merge-on-write) Support dynamic delete bitmap cache #32991
5. Reduce memory usage in alter. [fix](fe)reduce memory usage in alter (#32810) #33474
6. Support complex type for constant folding. [improve](fold) support complex type for constant folding #32867
7. Support aggregation model for Variant type. [Feature](Variant) support aggregation model for Variant type #33493
8. Support inverted index format v2 in CCR. [improvement](binlog)Support inverted index format v2 in CCR #33415
9. Optimize the performance of nested materialized view rewriting. [improvement](mtmv) Optimize the performance of nested materialized view rewriting #34127
10. Support decimal256 in rowstore. [Fix](Row store) support decimal256 type #34887

Bugfix

1. Fix no data error when read hive table on cosn TencentCloud.
2. Fix milliseconds_diff function return wrong result. [bug](function) fix milliseconds_diff function return wrong result #32897.
3. User define variables should be forward to master. [Fix](nereids) forward the user define variables to master #33013
4. Fix schema change fault when add complex type column. [Fix](schema change) Fix schema change fault when add complex type column #31824
5. Routine Load fix data lost when FE leader change. [fix](routine-load) fix data lost when FE leader change #33678
6. Fix routine load failed when can not find workload group. [Fix](executor)Fix routine load failed when can not find group #33596.
7. Support column string64 to avoid join failed in string size overflow the uint32. [Exec](join) Support column string64 to avoid join failed in string size overflow the uint32 (#33511) #33850
8. Create paimon catalog with hadoop user. [bugfix](paimon) Create paimon catalog with hadoop user #33833
9. Fix function_ipxx_cidr func with const param. [FIX]fix cidr func with const param #33968
10. 用hdfs进行还原时，提示failed to download|signature=323207|job_id=295022|error=[NOT_FOUND]failed to open file for md5sum [Bug] 用hdfs进行还原时，提示failed to download|signature=323207|job_id=295022|error=[NOT_FOUND]failed to open file for md5sum #33303
11. Fix column privilege problems related with hidden columns. [fix](Nereids) fix check column privilege failed by hidden column #34849
12. Fix arrow flight could not get correct IP in k8s deployment. [fix](arrow-flight-sql) Fix Arrow Flight bind wrong Host in Fqdn  #34850