Add Trino 423 release notes

[colebow]

Description

Assemble the release notes for the upcoming Trino 423 release. Fixes #18288

Release notes

(x) This is not user-visible or docs only and no release notes are required.

Verification for each pull request

Format: maintainer, PR/issue number, ✅ / ❌ rn ✅ / ❌ docs
✅ rn - release note added and verified, or assessed to be not necessary, set to ❌ rn before completion
✅ docs - need for docs assessed and merged, or assessed to be not necessary, set to ❌ docs before completion

13 Jul 2023

• Simplify getRawSystemTable in Delta Lake #18157 ✅ rn ✅ docs
• Fix TASK_SCALE_WRITERS_MAX_WRITER_COUNT in test #18276 ✅ rn ✅ docs

14 Jul 2023

• Remove unused Hive SERIALIZATION_DDL property #18261 ✅ rn ✅ docs
• Treat precision as NANOSECONDS for timestamp to be coerced  #18003 ✅ rn ✅ docs
• Catch exceptions for initial call to state change listener #18263 ✅ rn ✅ docs
• Increase maxLocalExchangeBufferSize to 128MB #18212 ✅ rn ✅ docs
• Test PruneGroupIdSourceColumns with groupingColumns #18278 ✅ rn ✅ docs
• Deduplicate symbols inside GroupIdNode grouping set #18257 ✅ rn ✅ docs
• Update oauth2-oidc-sdk to 10.11 #18246 ✅ rn ✅ docs
• Fix updating PR comments from tests with secrets workflow #18165 ✅ rn ✅ docs
• Allow assert-thrown with more focused ::evaluate  #18252 ✅ rn ✅ docs
• Reject invalid URIs in URI extract functions #18253 ✅ rn ✅ docs
• Do not ignore unparseable URIs in node management #18251 ✅ rn ✅ docs
• Support files with locations ending with whitespace #18206 ✅ rn ✅ docs
• Fix Iceberg MV failure after table roll back #18205 ✅ rn ✅ docs
• Remove deprecated Alluxio metastore #18195 ✅ rn ✅ docs
• Simplify addDriverFactory params #18292 ✅ rn ✅ docs
• Reduce Hive file system listing #18179 ✅ rn ✅ docs
• Use Hive native writers for creating empty bucket files #18235 ✅ rn ✅ docs
• Update openx serde used for testing. #18297 ✅ rn ✅ docs

15 Jul 2023

• Update dependencies #18232 ✅ rn ✅ docs

17 Jul 2023

• Reuse Page#getColumns in MemoryPagesStore #18306 ✅ rn ✅ docs
• Test Iceberg operations for information_schema.columns #18300 ✅ rn ✅ docs
• Add IntLogicalTypeAnnotation in parquet writer #18301 ✅ rn ✅ docs
• Kerberos delegation support #17853 ✅ rn ✅ docs
• Fix failure to read nullable time(6) columns #15606 ✅ rn ✅ docs

18 Jul 2023

• Avoid running expensive INSERT to assert on the plan and stats calculation fixes #18314 ✅ rn ✅ docs
• Remove unused clone() method #18311 ✅ rn ✅ docs
• Fix HiveType.getRetainedSizeInBytes for caching removal #18296 ✅ rn ✅ docs
• Verify Delta, Iceberg do not call file length unnecessarily #18294 ✅ rn ✅ docs
• Operate on column handle directly in checkPartitionTypesSupported and other cleanups #18316 ✅ rn ✅ docs
• Fix broken testDeletionVectors in Delta Lake #18325 ✅ rn ✅ docs

19 Jul 2023

• Set column types in Iceberg register_table #18302 ✅ rn ✅ docs
• Add Delta Lake $properties system table #17592 ✅ rn ✅ docs
• Various precision for Oracle timestamp #17934 ✅ rn ✅ docs
• Add test for UPDATE with multiple columns check constraint #18335 ✅ rn ✅ docs
• OpenTracingCollector fixes #18307 ✅ rn ✅ docs
• Support passing a connection URL to Trino CLI #12587 ✅ rn ✅ docs
• Update ignite to 2.15.0 #18342 ✅ rn ✅ docs
• Remove unused code #18344 ✅ rn ✅ docs

20 Jul 2023

• Add tracing for AccessControl #18338 ✅ rn ✅ docs
• Format CLI error messages #18346 ✅ rn ✅ docs
• Remove duplicate isIcebergTable, isDeltaLakeTable methods #18341 ✅ rn ✅ docs
• Use putIdentity method to reduce code duplication #18326 ✅ rn ✅ docs
• Fix HiveMetadata.streamTableColumns not to include views #18343 ✅ rn ✅ docs
• Test NULL handling compatibility for partition values #18360 ✅ rn ✅ docs
• Convert more documentation to markdown source #17759 ✅ rn ✅ docs

21 Jul 2023

• Support reading timestamp_ntz type (timestampNtz) in Delta Lake #17502 ✅ rn ✅ docs
• Support writing timestamp with time zone type on partitioned column in Delta #18353 ✅ rn ✅ docs
• Support updates when Delta table location has two trailing slashes #18177 ✅ rn ✅ docs
• Restrict timestamp to varchar coercion for historical dates #18004 ✅ rn ❌ docs

22 Jul 2023

• Add dynamic filter before splits #18378 ✅ rn ✅ docs
• Simplify PhasedExecutionSchedule #18377 ✅ rn ✅ docs
• Update Airlift to 235 #18373 ✅ rn ✅ docs
• Disallow creating Delta tables partitioned by array, map or row type #18355 ✅ rn ✅ docs
• Support TINYINT and SMALLINT in migration proceure from hive to iceberg #18369 ✅ rn ✅ docs
• Disallow creating Delta tables partitioned by all columns #18354 ✅ rn ✅ docs

23 Jul 2023

• Fix flaky BigQuery tests using snapshot tables #18357 ✅ rn ✅ docs
• Migrate redundant connector test to smoke test in Hudi #18359 ✅ rn ✅ docs
• Test S3 request count in Hive connector #18366 ✅ rn ✅ docs
• Support renaming a field with RENAME COLUMN in engine and Iceberg #16757 ✅ rn ❌ docs
• Add type mapping section #17573 ✅ rn ✅ docs
• Remove unused line from TableChangesFunction #18386 ✅ rn ✅ docs
• Update first_tested_version to 18 month ago in JDBC driver test #16701 ✅ rn ✅ docs
• Change heading level of case insensitive matching fragment #18394 ✅ rn ✅ docs
• Disable task level writer scaling from TableExecute #18388 ✅ rn ✅ docs

24 Jul 2023

• Use correct value for partition_values argument in drop_stats sample #18403 ✅ rn ✅ docs
• Update connector drivers #18400 ✅ rn ✅ docs
• Fix query failure due to unused dynamic filters #18385 ✅ rn ✅ docs
• Remove redundant TestHudiUtil and unused method #18409 ✅ rn ✅ docs
• Use pre-existing files in AbstractTestParquetPageSkipping #18407 ✅ rn ✅ docs
• Run JDBC driver compatibility test since 352 with dynamic step #18419 ✅ rn ✅ docs
• Fix iceberg optimize tests #18415 ✅ rn ✅ docs

26 Jul 2023

• Update Azure SDK to 1.2.14 #18410 ✅ rn ✅ docs
• Replace CountingAccessMetadata with OpenTelemetry #18417 ✅ rn ✅ docs
• Put S3 Select for TEXTFILE behind an experimental flag #18102 ✅ rn ✅ docs
• Throw meaningful exception when intending to update statistics for missing partition #18401 ✅ rn ✅ docs
• Small clarification in materialized views docs. #18431 ✅ rn ✅ docs
• Remove support for legacy Hive Parquet writer #18420 ✅ rn ✅ docs
• Update various dependencies #18414 ✅ rn ✅ docs
• Convert optimizer docs to markdown source #18430 ✅ rn ✅ docs

27 Jul 2023

• Remove unnecessary OperatorFactories interface #18426 ✅ rn ✅ docs
• Add support for varchar to timestamp coercion in hive tables #18014 ✅ rn ✅ docs
• Install JDBC drivers for Delta product tests at runtime and upgrade docker-images to version 81 #17667 ✅ rn ✅ docs
• Move test to AbstractTestHiveFileSystem #18172 ✅ rn ✅ docs
• Append random suffix in TestHiveWriteUtils #18404 ✅ rn ✅ docs
• Hive cleanup #18418 ✅ rn ✅ docs
• Disable buffering to disk for Azure output streams #18298 ✅ rn ✅ docs
• Update airlift/discovery-server to 1.36 #18435 ✅ rn ✅ docs
• Respect maxSize in TableChangesSplitSource.getNextBatch #18317 ✅ rn ✅ docs
• Support optimized local scheduling of kudu splits #18121 ✅ rn ✅ docs

28 Jul 2023

• Use shaded version of Coral #18444 ✅ rn ✅ docs
• Use direct dependency on Parquet #18445 ✅ rn ✅ docs

29 Jul 2023

• Ignore regular tests when mapping impacted modules for product tests #18459 ✅ rn ✅ docs

30 Jul 2023

• Add support for OpenTelemetry in Glue metastore #18458 ✅ rn ✅ docs
• Disallow dropping last non-partition column in Delta Lake #18381 ✅ rn ✅ docs

31 Jul 2023

• Improve tests for Iceberg handling of information_schema #18372 ✅ rn ✅ docs
• Convert more docs source to markdown #18432 ✅ rn ✅ docs
• Remove redundant HashSet from Identity.Builder #18469 ✅ rn ✅ docs

1 Aug 2023

• Enable NarrowingCompoundAssignment error-prone check #18466 ✅ rn ✅ docs
• Improve access control check for MV #18371 ✅ rn ✅ docs
• MySql case sensitive collation varchar push down support #18140 ✅ rn ✅ docs
• Cache Iceberg column types in Glue for faster access #18315 ✅ rn ✅ docs
• Fix code style error #18484 ✅ rn ✅ docs
• Fix scalar function adapter #18473 ✅ rn ✅ docs
• Mark SPI function annotations with Error Prone keep #18474 ✅ rn ✅ docs
• Add helper classes for deletion vector in Delta Lake #18269 ✅ rn ✅ docs
• Check type of filter expression at statement analysis #18460 ✅ rn ✅ docs
• MySQL LIKE predicate pushdown for varchar/nvarchar columns. #18441 ✅ rn ✅ docs
• Reduce max task writer scaling defaults #18488 ✅ rn ✅ docs
• Allow no compilation warnings in selected modules #18477 ✅ rn ✅ docs
• Record CASCADE when tracing ConnectorMetadata.dropSchema #18478 ✅ rn ✅ docs

2 Aug 2023

• GlueHiveMetastore cleanup #18483 ✅ rn ✅ docs
• Add support for materialized view column comments #18016 ✅ rn ✅ docs
• Optional check for query partition filter for Delta #18345 ✅ rn ✅ docs
• Document session property value consistently #18503 ✅ rn ✅ docs
• Mitigate testDynamicFiltering* flakiness #18323 ✅ rn ✅ docs
• Migrate aggregation function tests to JUnit #18191 ✅ rn ✅ docs
• Support setting a field type with SET DATA TYPE statement in engine and Iceberg #18395 ✅ rn ❌ docs
• Improve performance when planning multiple window functions #18504 ✅ rn ✅ docs

3 Aug 2023

• Remove duplicate logic for create/update Iceberg table in metastore  #18500 ✅ rn ✅ docs
• Test information_schema.columns against AccessControl.filterColumns #18505 ✅ rn ✅ docs
• Error Prone 2.21.0, NullableOptional check #18512 ✅ rn ✅ docs
• Convert more connector docs to markdown #18454 ✅ rn ✅ docs
• Remove redundant copy in ConnectorIdentity.Builder #18524 ✅ rn ✅ docs
• Create a fault tolerant execution smoke test for trino-redshift #18480 ✅ rn ✅ docs
• Remove redundant dependency #18528 ✅ rn ✅ docs
• Update JMH to 1.37 #18532 ✅ rn ✅ docs
• Suppress warning generated by WebUiStaticResource#getRoot #18374 ✅ rn ✅ docs

4 Aug 2023

• Remove redundant lowercasing in Delta error messages #18523 ✅ rn ✅ docs
• Estimate row count when BETWEEN value is an expression #18501 ✅ rn ✅ docs
• Support reading time millis columns in optimized parquet #18535 ✅ rn ✅ docs
• Remove redundant ORDER BY from WITH and views #18159 ✅ rn ✅ docs
• Increase PAGE_SIZE_IN_BYTES limits in PageProcessor #18531 ✅ rn ✅ docs
• Change wording to clear any misunderstanding #18548 ✅ rn ✅ docs

5 Aug 2023

No merges.

6 Aug 2023

• Fix typo #18560 ✅ rn ✅ docs

7 Aug 2023

• Fix bug Delta column operations erases its properties on uppercase names #18123 ✅ rn ✅ docs
• Glue catalog cleanup #18543 ✅ rn ✅ docs
• Add support for comment on view in blackhole connector #18516 ✅ rn ✅ docs
• Update error-prone to 2.21.1 #18552 ✅ rn ✅ docs
• Update oauth2-oidc-sdk to 10.13 #18529 ✅ rn ✅ docs
• Add diagnostic logging for TrinoS3FileSystem delete #18494 ✅ rn ✅ docs
• Use single tablet server replica for Kudu tests #18549 ✅ rn ✅ docs
• Reduce dns lookup overhead on NodeScheduler #18365 ✅ rn ✅ docs
• Update SQL support docs for Blackhole #18534 ✅ rn ✅ docs
• Add metastore-level test for column properties #18567 ✅ rn ✅ docs
• Format function cleanup #18492 ✅ rn ✅ docs
• Increase writerScalingMinDataProcessed threshold for scaling test #18319 ✅ rn ✅ docs

8 Aug 2023

• Performance improvements for the Delta Lake history system table  #18427 ✅ rn ✅ docs
• Fix default file format in Iceberg doc #18577 ✅ rn ✅ docs
• Accelerate system.metadata.table_comments with Iceberg Glue catalog #18517 ✅ rn ✅ docs
• Support predicate pushdown on char and decimal type in mongodb #18382 ✅ rn ✅ docs
• Reduce redundant code in procedure declarations #18569 ✅ rn ✅ docs
• Add @Flaky annotation to testNonTransactionalMetadataDelete #18576 ✅ rn ✅ docs
• Enable NarrowCalculation error-prone check #18479 ✅ rn ✅ docs
• Extract a method to decide deleting database data in Hive metastore #18575 ✅ rn ✅ docs
• Update roaringbitmap to 0.9.47 #18530 ✅ rn ✅ docs
• Update JDBI to 3.40.0 #18527 ✅ rn ✅ docs
• Rename experimental config #18541 ✅ rn ✅ docs
• Add example for RESTRICT keyword #18571 ✅ rn ✅ docs
• Fix Delta ANALYZE for mixed case columns #18583 ✅ rn ✅ docs
• Add support for writer version 6 without DML in Delta Lake #18200 ✅ rn ✅ docs
• Use tracing for testing ConnectorMetadata invocations  #18587 ✅ rn ✅ docs

9 Aug 2023

• Drop deprecated optimizer.use-mark-distinct #18540 ✅ rn ✅ docs
• Update maven to 3.9.4 #18547 ✅ rn ✅ docs
• Do not use metadata deletes during Iceberg writes #18533 ✅ rn ✅ docs
• Kafka insert prep #18485 ✅ rn ✅ docs
• Don't build upstream dependencies with errorprone #18598 ✅ rn ✅ docs
• Kafka insert prep #18485 ✅ rn ✅ docs
• Coerce boolean type for filter expression #18551 ✅ rn ✅ docs
• Simplify boolean expression in QueryPlanner #18604 ✅ rn ✅ docs
• Show original characters for string literals instead of escaping #18256 ✅ rn ✅ docs
• Restore original behavior for URI extract functions #18612 ✅ rn ✅ docs

10 Aug 2023

• Use Antlr's built-in case insensitive lexing support #18614 ✅ rn ✅ docs
• Rename variable in Glue catalog modules #18465 ✅ rn ✅ docs
• Revert "Reduce redundant code in procedure declarations" #18619 ✅ rn ✅ docs
• Remove redundant QualifiedTablePrefix.matches checks #18607 ✅ rn ✅ docs
• Deprecate getTableHandle without versions #18596 ✅ rn ✅ docs
• Accelerate information_schema.columns with bulk retrieval #18586 ✅ rn ✅ docs
• Get result iterator in PinotBrokerPageSource constructor #18602 ✅ rn ✅ docs
• Add support for DROP SCHEMA CASCADE in JDBC connectors #18305 ✅ rn ✅ docs
• Remove supportsReportingWrittenBytes from SPI #18617 ✅ rn ✅ docs
• Use ChunkedSliceOutput to chunk and buffer writes in parquet #18564 ✅ rn ✅ docs
• Fix structure and execution of type tests #18594 ✅ rn ✅ docs