Release notes for 340

[martint]

Dain Sundstrom

• all checked
• 07-22 17:21:09 1d5c135 Fix TestQueryStateInfoResource setup hang
• 07-29 22:16:55 01d362e Move AggregationFunctionMetadata to SqlAggregationFunction
• 07-29 22:16:55 047176e Cleanup RowType makeSignature
• 07-29 22:16:55 05a3589 Remove old calling convention code from scalars
• 07-29 22:16:55 1daa1f8 Simplify SpecialForm byte code generators
• 07-29 22:16:55 212c36e Remove SignatureBinder.bindVariables
• 07-29 22:16:55 2379c52 Remove unused function kind from signature builder
• 07-29 22:16:55 376a6d3 Reduce uses of FunctionBinding in getFunctionDependencies
• 07-29 22:16:55 39dddd4 Simplify resolved function encoding to qualified name
• 07-29 22:16:55 4336c25 Add FunctionBinding
• 07-29 22:16:55 45c96e7 Add function and type dependencies to ResolvedFunction
• 07-29 22:16:55 599663b Change aggregation specialize argument to FunctionBinding
• 07-29 22:16:55 5b9c88f Add BoundSignature for use in ResolvedFunction
• 07-29 22:16:55 65b024e Change scalar function specialize argument to FunctionBinding
• 07-29 22:16:55 677d225 Remove bulk getters for FunctionBinding type variables
• 07-29 22:16:55 68de721 Change window function specialize argument to FunctionBinding
• 07-29 22:16:55 6a83400 Inline SqlScalarFunction builder method
• 07-29 22:16:55 a1b99bb Remove unused methods and data from InternalAggregationFunction
• 07-29 22:16:55 a8cc411 Use BoundVariable.Builder in tests
• 07-29 22:16:55 c5b8b46 Add SignatureBinder.extractBoundVariables
• 07-29 22:16:55 cad9e3a Add functions dependencies to RowExpression
• 07-29 22:16:55 cd0abb9 Remove unused methods and data from ScalarFunctionImplementation
• 07-29 22:16:55 d9da4f7 Replace Metadata with FunctionDependencies in agg and window
• 07-29 22:16:55 da28161 Add equal and hash code benchmarks
• 07-29 22:16:55 e417e14 Encapsulate BoundVariables in SignatureBinder
• 08-01 20:55:42 d4f5eb5 Add user mapping to insecure authenticator
• 08-02 17:48:00 88db105 Clarify handling of wildcards and nulls in TestingAccessControlManager
• 08-03 11:13:14 10a986b Fallback to FileInputStream if PemReader fails to read certificates
• 08-05 12:56:52 8131d34 Fix adaptation from Slice to Object stack type

David Phillips

• all checked
• 07-21 18:22:17 6398acc Change Iceberg to use ParquetFileWriter
• 07-21 18:56:54 961c99f Wrap arguments for Error Prone
• 07-21 19:56:12 4781354 Fix loading of PartitionFieldSummary in ManifestsTable
• 07-24 09:01:23 063a747 Add remote Host info to PageTransportErrorException
• 07-24 19:18:52 fa49bf2 Remove omitDatetimeTypePrecision from SPI
• 07-27 09:30:00 2cf1ca3 Avoid checking isSplittable for files smaller than initial split size
• 07-27 16:12:32 913d42f Add luhn_check function
• 07-28 10:15:44 03720b3 Replace stream with string join
• 07-28 10:15:44 771f014 Remove unnecessary TypeTranslator interface
• 07-28 10:15:44 8c2c2ef Remove unnecessary CoercionPolicy interface
• 07-28 23:03:32 cd8f939 Remove deprecated split manager methods from Hive
• 07-28 23:03:32 f4bca50 Deprecate legacy ConnectorSplitManager methods
• 07-29 15:01:17 6d7f350 Fix HDFS impersonation in Iceberg Connector
• 07-29 15:01:17 e313142 Add Iceberg in Kerberos product tests
• 07-30 11:14:16 2548e08 Clarify Java 11 min requirement
• 07-30 13:51:22 d8f06ef Add known limitations
• 08-01 11:53:53 216c051 Product test environment for Iceberg
• 08-01 11:53:53 4058c66 Trivial Iceberg product test
• 08-04 12:46:31 9ff4863 Mark the fields of ROW Type optional for Iceberg schema
• 08-04 17:39:24 f4294ab Improve documentation for datetime %r and %T
• 08-05 19:02:49 1fb4fd1 Improve performance of reading Hive JSON tables

Grzegorz Kokosiński

• all checked
• 07-29 01:10:42 f78e760 Update log4j dependency version to 2.13.3
• 07-29 01:14:21 283f511 Expose QueryType in QueryContext
• 07-29 10:58:14 6c70a0a Add execution of TPCDS product tests
• 07-29 10:58:46 fc22199 Added Presto logo in README.md that looks nicer
• 07-30 02:21:30 2e966e4 Order GHA job exclusions
• 07-30 02:50:57 3d448a1 Introduce JDBC RemoteTableName
• 07-30 02:50:57 bfde029 Pass RemoteTable to createTableSql
• 07-30 02:50:57 dd08921 Add missing Nullable annotations
• 07-31 04:13:45 349dc7c Make QueryBuilder::toPredicate to be customizable
• 07-31 04:13:45 7efee22 Remove unused annotation
• 07-31 04:13:45 a1ef1f2 Reuse BaseJdbcClient methods in QueryBuilder
• 07-31 04:13:45 f78393b Do not pass columnName as separate parameter
• 07-31 04:13:45 fe46bdf Use RemoteTableName in BaseJdbcClient where reasonable
• 08-01 10:24:41 66c405b Restore customizable QueryBuilder#getRelation
• 08-05 05:06:09 715df4d Decrease visibility of @VisibleForTesting method
• 08-05 05:06:09 94f2ae2 Check permission to access columns in CREATE TABLE (LIKE)
• 08-06 00:30:38 0ae1796 Mount test report directory into tests container
• 08-06 00:30:38 1538372 Save product tests reports in host directory
• 08-06 00:30:38 725186e Remove deprecated getExitCode method

Karol Sobczak

• all checked
• 07-27 08:39:59 e6c960e Add toggle for specifying dynamic filtering refresh interval
• 07-30 02:05:02 54d175f Add max error retry config option to glue client
• 07-30 02:21:44 15ffd9c Cancel sub stages in FLUSHING state
• 07-30 02:21:44 657e8cf Fix imports and cleanup in TestSqlTaskExecution
• 07-30 02:21:44 8798be8 Add FLUSHING state to tasks and stages
• 07-30 02:45:26 547eb1a Use length of VarcharType and CharType to calculate EXPECTED_ENTRY_SIZE
• 07-30 02:45:26 deb9c13 Use getInt to access IntArrayList
• 07-30 11:55:13 14d8a64 Use MoreFutures.tryGetFutureValue
• 08-04 02:40:29 c56f90a Apply DomainTranslator to STARTS_WITH function
• 08-04 03:20:17 ac4d3c8 Fix benchto dependency
• 08-04 12:04:58 845bab1 Fix formatting
• 08-06 06:01:16 b631eb8 Remove unused variable
• 08-06 07:03:21 2a5de1c Move impersonation check to DefaultRubixHdfsInitializer
• 08-06 07:03:21 4b47fff Make RubixInitializer#updateRubixConfiguration private
• 08-06 07:03:21 ff9f050 Allow to override binding of Hdfs filesystem for caching
• 08-06 07:38:55 79ebfe5 Add missing synchronize

Martin Traverso

• all checked
• 07-21 23:15:28 0535a43 Make TimeZoneKey case-sensitive
• 07-24 14:00:13 02c5bf1 Throw semantic exception when '?' is passed for parameter
• 07-24 14:00:13 07ab946 Support LIMIT clause with parameter
• 07-25 11:01:07 74edaa3 Use global high memory split source counter
• 07-27 18:32:27 b8807b4 Ignore ES indexes without mappings
• 07-27 18:36:00 696c41a Refactor coerce() method
• 07-27 18:36:00 b57236f Add method for pruning invisible fields
• 07-28 11:35:13 36c4fb8 Add parser label for LIMIT value
• 07-28 11:35:13 3cfc51b Extract method for analyzing parameter as row count
• 07-28 11:35:13 5dcd462 Support parameter in OFFSET clause
• 07-28 11:35:13 64b6442 Fix formatting
• 07-28 11:35:13 cf24a49 Support parameter in FETCH FIRST clause
• 07-28 11:35:13 d825de3 Handle null passed for parameter in LIMIT
• 07-28 11:35:13 e748264 Extract parser rule for rowCount
• 07-28 11:35:13 ee6e19f Add test for type mismatch in LIMIT parameter
• 07-29 09:42:08 5e4aa46 Fix failure with repeated complex expressions in group by clause
• 07-29 09:42:08 6995780 Add tests for group by expressions with mixed reference style
• 07-29 17:47:14 4c40e9b Simplify negative anyMatch usage
• 07-29 18:38:14 6f133e7 Remove unused constant
• 07-31 17:54:29 417c859 Fix unaliasing ExchangeNode outputs
• 08-03 16:21:11 aa7b555 Handle reused symbols in ProjectNode
• 08-04 20:41:02 3602068 Add support for TopN pushdown
• 08-06 09:25:38 277f154 Support bitwise shift functions

Piotr Findeisen

• all checked
• 07-21 13:52:50 1c110c8 Make skip.header.line.count=1 files splittable
• 07-21 13:52:50 5fda809 Add unit test for split boundary logic
• 07-22 01:33:59 883e38d Do not call getTableDefaultLocation if external_location present in CTAS
• 07-22 04:56:31 9be344c Move testCreateExternalTableWithInaccessibleSchemaLocation to TestExternalHiveTable
• 07-23 04:12:49 8db1d3a Remove layouts from statistics docs
• 07-23 04:21:22 84d3b06 Ensure to pushdown the aggregation for count(const)
• 07-24 08:26:59 62e1622 Add read support for original files of ACID/Transactional tables
• 07-25 12:11:28 0eace40 Correct parameter name
• 07-25 12:11:28 a96aa9c Support CTAS for Hive transactional tables
• 07-25 12:11:28 fdddcda Improve exception message
• 07-25 13:00:20 bc99763 Change name of Kafka createTopics to match parameter type
• 07-25 13:08:47 de70a06 Use consistent title for limitations section
• 07-25 13:19:08 ba4ba75 Add security policy
• 07-27 00:25:42 65b509d Reduce data size in TestCsv
• 07-27 00:58:43 d72622d Ignore empty folder placeholder files on S3
• 07-27 13:51:18 7f621cc Remove redundant Iceberg smoke test
• 07-28 14:43:26 a519b32 Removed Auth Token from Exception Message
• 07-28 23:37:25 0222860 Add initial support for ResultSet#getObject with type
• 07-28 23:37:25 5d8d588 Reorder tests
• 07-28 23:37:25 804b173 Test row representation in JDBC ResultSet
• 07-28 23:37:25 df0313f Test map representation in JDBC ResultSet
• 07-28 23:37:25 f4268a8 Split test method into multiple
• 07-29 23:50:20 3137cde Remove unnecessary TODO
• 07-29 23:58:26 4efe924 Fix handling of dates and timestamps before the 20th century
• 07-30 23:23:57 85204c1 Add Kafka Json encoder
• 07-31 04:26:00 0ae4c1c Fix BenchmarkPlanner
• 07-31 06:06:05 b8c343f Test if older JDBC clients are compatible with current Presto server
• 07-31 14:22:25 613d8eb Throw specific exception when conversion fails
• 08-04 12:21:20 4495f88 Extend Parquet timestamp support

Yuya Ebihara

• all checked
• 07-21 19:21:44 a6e01fc Add debug log for Cassandra query
• 07-21 19:21:44 e533c3a Remove unused argument in CassandraSession.execute
• 07-21 19:25:46 a29e295 Add max idle time configuration in MongoDB connector
• 07-24 05:27:57 a3f7fbc Drop apex user with initialization sql in TestingOracleServer
• 07-26 03:47:16 ea9d0b3 Remove unused ElasticsearchColumn class
• 07-29 04:56:56 3593139 Fix NPE when listing schemas in Phoenix connector
• 08-02 00:25:54 375c5b6 Remove unused connection timeout property in Kafka
• 08-05 18:49:01 039d3a6 Avoid type coercion when a dereferenced field is same type
• 08-06 06:53:22 b22131b Remove redundant Glue catalogid from documentation

Łukasz Osipiuk

• all checked
• 07-22 04:01:56 8472b62 Add Kafka raw encoder
• 07-22 04:01:56 eab750d Improve Kafka round trip test
• 07-23 08:59:53 6c6bbc4 Update tempto to 180
• 07-24 05:33:41 58b97eb Sort modules in parent pom
• 07-24 05:33:41 5c8f7a7 Sort dependencyManagent in parent pom
• 07-24 05:33:41 5cdebea Sort dependencies in POMs
• 07-24 05:33:41 9370770 Enforce proper order of dependencies in pom files
• 07-24 05:33:41 b91371f Fix parent pom structure
• 07-25 00:21:03 d01ee59 Cleanup in LambdaCaptureDesugaringRewriter

[findepi]

Hive
* Improve performance when querying tables with ``skip.header.line.count`` property set to 1. (:issue:`4513`)

#4513

[ebyhr]

MongoDB
* Add ``mongodb.max-connection-idle-time`` properties to limit the maximum idle time of a pooled connection. ({issue}`4483`)

#4483

[findepi]

Hive
* Allow creating a table with ``external_location`` when schema's location is not valid. (:issue:`4069`)

#4069
#4279

[losipiuk]

Kafka
* Add INSERT support for Raw data format. (:issue:`4417`)

#4417 #3980

[findepi]

PostgreSQL
* Push down `count()` aggregation over constant expression (e.g. `count(1)`). {issue}`4362`

#4362 #4473

[findepi]

Hive
* Add read support for tables that were created as non-transactional and converted to be
  transactional later. ({issue}`2293`)

#2293
#2930

[martint]

* Add support for query parameters in `LIMIT`, `OFFSET` and `FETCH FIRST` clauses. ({issue}`4529`, {issue}`4601`)

#4529
#4601

[findepi]

Hive
* Allow creation of transactional tables. Note: inserts to transactional tables
  are still not supported. ({issue}`4516`)

#4516
#4574

[findepi]

Hive
* Fix query failure when S3 data location contains `_$folder$` Hadoop s3n marker object. ({issue}`4552`)

#4552

[sopel39]

General
* Improve dynamic partition pruning for short queries. ({issue}`4388`}

#4388

[kokosing]

General
* Expose information about query type in query Event Listener. ({issue}`4592`)

#4592

[ebyhr]

Phoenix
* Fix ``NullPointerException`` when listing schemas. ({issue}`4560`)

#4560

[martint]

* Fix failure when duplicate expressions are referenced in the `GROUP BY` clause. ({issue}`4609`)

#4609

[findepi]

JDBC
* Fix handling of dates and timestamps before the 20th century. ({issue}`4563`)

#4563

[sopel39]

Hive
* Add feature toggle (`hive.metastore.glue.max-error-retries`) for configuring number of retries in Glue client. ({issue}`4611`)

#4611

[sopel39]

General
* Reduce CPU load by cancelling query stages from which data is no longer required. ({issue}`4290`)

#4290

[sopel39]

General
* Reduce query memory usage by improving retained size estimation for `VARCHAR` and `CHAR` types. ({issue}`4123`)

#4123

[findepi]

Kafka
* Add insert support for JSON. ({issue}`4477`)

#4477

[martint]

* Fix potential hang during query planning ({issue}`4635`).

#4635

[ebyhr]

Kafka
* Remove unused ``kafka.connect-timeout`` configuration properties. ({issue}`4664`)

#4664

[dain]

Hive
* Add support for Java Key Store (extending existing PEM support) to Thrift Hive meta store TLS configuration. ({issue}`4432`)

#4432

[sopel39]

General
* Improve query performance for queries containing ``starts_with`` predicates. ({issue}`4669`)

#4669

[martint]

SPI
* Add support for TopN pushdown via the `ConnectorMetadata.applyLimit()` method. ({issue}`4249`)

#4249

[kokosing]

Security
* Verify access to referenced table in `CREATE TABLE LIKE`. ({issue}`4472)

#4472

[ebyhr]

Hive
* Fix type coercion failure when the schema evolved without type changes. ({issue}`3967`)

#3967

[martint]

* Add bitwise shift functions. ({issue}`772`)

#722

[martint]

Elasticsearch
* Fix failure when index mapping is missing. ({issue}`4535`)

#4535

[kokosing]

Hive
* Expose hit rate statistics for Hive metastore cache via JIMX. ({issue}`4458`)

#4458

[kokosing]

General
 * Add `IF EXISTS `and `IF NOT EXISTS` syntax to `ALTER TABLE`. ({issue}`4651`)

#4651

[Praveen2112]

Phoenix
* Add table level property to specify data block encoding when creating Phoenix tables

#4617

[sopel39]

General
* Improve performance of queries that use decimal data type. ({issue}`4730`)

#4730

[electrum]

General
* Include remote host in error info for page transport errors. ({issue}`4511`)

#4511

[electrum]

General
* Add {func}`luhn_check`. ({issue}`4011`)

#4011

[electrum]

## SPI Changes

* Deprecate the older variants of `ConnectorSplitManager.getSplits()`. ({issue}`4508`)

#4508

[electrum]

## Hive Changes

* Improve performance of reading JSON tables. ({issue}`4705`)

#4705

[electrum]

## General Changes

* Enable HTTP/2 by default for internal communication. This can be disabled using the
  `internal-communication.http2.enabled` configuration property. ({issue}`4696`)

#4696

[martint]

* Add experimental support for recursive queries. ({issue}`4250`)

#4250