Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release notes for 320 #1570

Closed
6 tasks done
electrum opened this issue Sep 22, 2019 · 19 comments · Fixed by #1676
Closed
6 tasks done

Release notes for 320 #1570

electrum opened this issue Sep 22, 2019 · 19 comments · Fixed by #1676
Labels
release-notes
Milestone
320

Comments

@electrum
Copy link
Member

electrum commented Sep 22, 2019 •
edited
Loading

Dain Sundstrom

  • all checked
  • 09-27 17:28:27 455d0a8 Small Optimizing Refactors in CachingHiveMetastore
  • 09-27 17:28:27 8765c76 Cache hashCode in CachingHiveMetastore.WithIdentity
  • 09-28 09:30:03 ed42cb2 Move Hive ORC class into orc package
  • 09-28 10:19:55 ade78c2 Rename OrcFileWriterConfig to OrcWriterConfig
  • 09-28 11:29:51 ba21d89 Move remaining Hive ORC writer configs to OrcWriterConfig
  • 09-28 13:07:27 88dd641 Move Hive ORC reader configs to OrcReaderConfig
  • 09-29 19:12:21 0a01665 Add OrcReaderOptions to simplify OrcReader construction

David Phillips

  • all checked
  • 09-23 11:40:48 b5a6a8f Support Hive metastore impersonation
  • 09-23 15:01:47 b142e8a Decouple OrcPageSource from HiveColumnHandle
  • 09-23 15:02:37 f702af7 Update JLine
  • 09-23 15:03:06 1239544 Remove unused OrcFileWriterConfig from Iceberg
  • 09-23 15:03:06 35b2325 Cleanup config handling in PrestoS3ClientFactory
  • 09-23 15:03:06 44e6304 Extract HiveAuthenticationConfig
  • 09-23 15:03:06 72f714c Extract ParquetReaderConfig
  • 09-23 15:03:06 7524a44 Move S3Select classes to separate package
  • 09-23 15:03:06 7946129 Extract HiveS3TypeConfig
  • 09-23 15:03:06 9479a9d Extract HdfsConfig
  • 09-23 15:03:06 98cdce7 Configure HDFS SOCKS proxy separately from metastore
  • 09-23 15:03:06 9b3c162 Use enumProperty helper in HiveSessionProperties
  • 09-23 15:03:06 d7a0a90 Rename ParquetFileWriterConfig to ParquetWriterConfig
  • 09-23 15:03:06 d7f717f Move text reader config out of HdfsConfigurationInitializer
  • 09-23 15:03:06 e5cdc1f Move ConfigurationInitializer to correct package
  • 09-23 15:03:06 ea5e240 Remove unused DirectoryLister from Iceberg
  • 09-23 15:03:35 55fe640 Add Hive session property for compression codec
  • 09-23 15:03:35 aac07f6 Extract CompressionConfigUtil
  • 09-23 15:03:36 40fd8ae Remove unused HiveConfig from HdfsConfigurationInitializer
  • 09-23 15:03:36 d4ee901 Replace HiveConfig with IcebergConfig
  • 09-23 15:14:56 767e1f4 Update 319 release notes
  • 09-25 10:57:35 e78fafd Improve Kinesis documentation
  • 09-27 12:52:49 90fbe03 Database based SessionPropertyConfigurationManager implementation
  • 09-27 12:52:49 f870e5c Moving file based session property manager classes to a separate package
  • 09-30 15:48:59 783dc4b Decouple ParquetPageSource from HiveColumnHandle
  • 10-02 13:46:47 7db98e6 Update example EXPLAIN output in documentation
  • 10-03 15:16:21 25d91e6 Remove unnecessary custom future implementation
  • 10-03 15:16:21 261cea1 Use delayed blackhole table instead of cross join
  • 10-03 15:16:21 3aa0c23 Make JDBC WarningsManager package-private
  • 10-03 15:16:21 3bcda70 Move JDBC warnings to Statement
  • 10-03 15:16:21 c775e89 Remove unused WarningsManager from PrestoConnection
  • 10-03 15:16:21 cfba397 Move executor to test setup
  • 10-03 15:17:23 bfa7237 Minor correction in docs related to Web Interface
  • 10-03 15:26:22 956ebb7 Code cleanup in SqlTime* classes

Grzegorz Kokosiński

  • all checked
  • 09-30 12:14:17 00cc4a3 Improve catalog creation methods name
  • 10-01 01:49:11 c152592 Use dockerized testing PostgreSql server
  • 10-01 06:31:14 21e9fe7 Add test for Accumulator.addInput from WindowIndex
  • 10-01 06:31:14 51bf5ec Roll window aggregations instead of recomputing
  • 10-01 06:31:14 e8cf714 Allow rolling sum for window functions
  • 10-01 06:39:15 5de8fec Do defensive copy of roles when creating Identity
  • 10-01 06:39:15 d3d3632 Introduce a builder for Identity
  • 10-01 11:33:40 718bcb5 Rename postgresql_connector to postgresql product test group
  • 10-01 11:33:40 ffedc9a Merge mysql_connector into mysql product test group
  • 10-02 06:11:32 69cdb49 Remove obsolete artifacts deploying by Travis
  • 10-02 12:14:18 aab1090 Remove empty files left behind after mounting with different name

Karol Sobczak

  • all checked
  • 09-25 04:30:04 7195e05 Fix predicate pushdown for identity projections
  • 09-27 12:20:09 8d82a10 Remove unused method
  • 09-27 12:20:09 f1a1277 Reduce method visibility
  • 09-30 07:41:35 74b2825 Simplify JoinGraph#isTrivialGraph
  • 09-30 07:41:35 b78775d Do not push projections through outer joins
  • 10-01 01:36:42 d78072f Remove unused method
  • 10-01 02:03:36 e2a81a5 Add support for Glue metastore cache
  • 10-01 12:38:25 42b5965 Reduce method visibility
  • 10-01 12:38:25 5582a32 Add debug logging to getInformationSchemaTable
  • 10-02 08:20:32 242d833 Remove unused variable
  • 10-02 08:25:39 1725223 Inline to a local variable
  • 10-02 08:25:39 556afcc Remove redundant table scan predicate during predicate pushdown
  • 10-02 08:25:39 6e3f789 Add PushPredicateIntoTableScan test where pushed domain is narrower
  • 10-02 08:25:39 a9c94c1 Remove redundant tests
  • 10-02 08:25:39 ad16ab7 Extract PushPredicateIntoTableScan#createResultingPredicate
  • 10-02 08:25:39 eade180 Add BasePlanTest#assertPlan that accepts session
  • 10-02 08:25:39 eecd1b7 Add support for LIKE to expression verifier

Martin Traverso

  • all checked
  • 09-23 12:25:42 eb8a065 Update from Guava to Java streams
  • 09-24 06:37:48 4c1df5c Remove unused variable from ShowQueriesRewrite
  • 09-24 06:37:48 51fdb53 Ensure Parameters are in proper order for queries having WITH clause
  • 09-24 06:47:17 2690001 Add Kinesis connector
  • 09-28 16:24:14 4e48a72 Fix comment
  • 09-28 16:24:14 5e80f1e Reuse original node Ids
  • 09-28 16:24:14 8638a8c Extract method for creating TranslationMap in RelationPlanner
  • 09-28 16:24:14 b541da6 Add join type and filter to UnnestNode
  • 09-29 15:37:56 4e5549e Fix index out of bounds during parser error handling
  • 10-01 20:49:08 017da0d Reorganize Metadata vs Client
  • 10-01 20:49:08 0ce52fa Embed index and type in ES connector handle
  • 10-01 20:49:08 4d0dae6 Remove unused parameter
  • 10-01 20:49:08 5cebe63 Encapsulate logic for fetching shards
  • 10-01 20:49:08 6f833e0 Delete scroll when cursor is closed
  • 10-01 20:49:08 739d074 Update Elasticsearch to http client
  • 10-01 20:49:08 785e4c5 Move ES node configuration to per-catalog
  • 10-01 20:49:08 abf8ba4 Inline method
  • 10-01 20:49:08 af89181 Rename ElasticSearchConnectorConfig
  • 10-01 20:49:08 c5b6d85 Fix typo
  • 10-01 20:49:08 cccdd45 Remove indexExactMatch from ES connector
  • 10-01 20:49:08 df740ab Cache Elasticsearch clients
  • 10-01 20:49:08 e96d2f4 Use shard primary host
  • 10-01 20:49:08 fe3d630 Remove unnecessary abstractions in ES connector
  • 10-01 20:49:08 fec68a9 Simplify method
  • 10-03 17:27:06 1d061fb Load tables dynamically in Elasticsearch
  • 10-03 17:27:06 36d418f Speed up loading test data into Elasticsearch
  • 10-03 17:27:06 c43d1d0 Adjust Elasticsearch timeout defaults
  • 10-03 21:46:32 feabe67 Add support for Elasticsearch query string syntax

Piotr Findeisen

  • all checked
  • 09-24 13:51:08 099121c Recommend IDE configuration
  • 09-25 01:37:25 a520d7e Prevent open client leak
  • 09-25 02:36:47 91f7679 Minor warnings cleanup in StatementAnalyzer
  • 09-26 07:01:42 445b7a5 Log full stacktrace in TaskExecutor
  • 09-26 12:07:03 22cfc91 Propagate access control exception from metastore
  • 09-26 14:03:09 3bce1c2 Verify LazyBlockLoader not called twice
  • 09-27 00:42:06 24ee0e4 Move getColumns method to a better place
  • 09-27 00:42:06 57be906 Prevent incorrect results when escape string not provided
  • 09-27 00:42:06 db2bc0b Add more logging in JDBC connectors
  • 09-27 00:50:33 10cf82d Respect original column type when inserting
  • 09-27 00:50:33 6845a1d Add null writer to ColumnMapping
  • 09-27 00:50:33 e8a65d9 Code cleanup
  • 09-27 23:02:42 a873fcf Use delegation token for kerberized metastore
  • 09-30 01:17:20 c6c1feb Fix misleading 'Table not found' message
  • 09-30 03:19:19 6e9f949 Remove duplicate configuration
  • 09-30 13:02:28 5b3eaad Deprecate SqlTimeWithTimeZone constructor with j.u.TimeZone
  • 09-30 13:02:50 b0d3a0c Remove duplicate binding in Iceberg
  • 09-30 13:21:04 69cb541 Remove redundant else
  • 09-30 13:49:03 8a656f2 Update docker images to 20
  • 09-30 14:10:54 55d484e Rename ThriftHiveMetastoreConfig to ThriftMetastoreConfig
  • 10-01 00:14:26 09f363d Make MySQL Driver's useInformationSchema configurable
  • 10-01 01:01:13 4ec9c2a Disable stats auto-gathering in Hive
  • 10-01 01:01:13 e1d4bcc Fix running product tests on HDP 3.1
  • 10-01 06:34:28 1dd7ae9 Forbid hive.metastore.username in kerberized metastore
  • 10-01 06:34:28 ae41ee2 Mark parameter as @nullable
  • 10-01 06:34:42 2d53c7c Temporarily force bucketing v1 in test
  • 10-01 06:34:42 eaf51c9 Use scientific notation for doubles in HQL
  • 10-01 07:25:11 f33591c Remove unnecessary conditions from FileBasedAccessControl
  • 10-02 12:47:07 87ce835 Support System tables at PostgreSQLClient
  • 10-03 06:18:14 fd01f9c Improve numbers legibility in CLI
@electrum electrum added this to the 320 milestone Sep 22, 2019
@martint
Copy link
Member

martint commented Sep 24, 2019 

* Fix incorrect parameter binding order when parameters appear inside a ``WITH`` clause. (:issue:`1191`)

#1191

@martint
Copy link
Member

martint commented Sep 24, 2019 

* Add Amazon Kinesis connector. (:issue:`476`)

#476

@sopel39
Copy link
Member

sopel39 commented Sep 25, 2019 •
edited
Loading 

General
-------

* Extend predicate push-down through identity projections. (:issue:`1515`)

#1515

@sopel39
Copy link
Member

sopel39 commented Sep 30, 2019 •
edited
Loading 

General
-------

* Fix projection pushdown during cross-join elimination when outer join is present. (:issue:`1589`)

#1589

@findepi
Copy link
Member

findepi commented Oct 1, 2019 

MySQL
* Add ``mysql.jdbc.use-information-schema`` configuration option to control whether
  MySQL JDBC driver should use MySQL ``information_schema`` to answer metadata
  queries. This may be helpful when diagnosing problems. (:issue:`1598`)

#1598

@sopel39
Copy link
Member

sopel39 commented Oct 1, 2019 •
edited
Loading 

Hive
----

* Add support for Glue metastore caching. (:issue:`1625`)

#1625

@kokosing
Copy link
Member

kokosing commented Oct 1, 2019 

General
--------
* Allow rolling aggregations for window functions. (:issue:`464`)

#464

@kokosing
Copy link
Member

kokosing commented Oct 1, 2019 

SPI
---
* Introduce a ``Builder`` for ``Identity`` and deprecate its public constructors. (:issue:`1624`)

#1624

@sopel39
Copy link
Member

sopel39 commented Oct 2, 2019 •
edited
Loading 

General
-------

* Remove redundant table scan predicates if they are enforced by connector. (:issue:`1516`)

#1516

@findepi
Copy link
Member

findepi commented Oct 2, 2019 

PostgreSQL
* Add support for reading PostgreSQL system tables, e.g. ``pg_catalog`` relations.
  The functionality is disabled by default and can be enabled using ``postgresql.include-system-tables``
  configuration property. (:issue:`1527`)

#1527

@martint
Copy link
Member

martint commented Oct 4, 2019 •
edited
Loading 

Elasticsearch
* Add support for ``VARBINARY``, ``TIMESTAMP``, ``TINYINT``, ``SMALLINT`` and ``REAL`` data types. (:issue:`1639`)
* Discover available tables and their schema dynamically. (:issue:`1639`)
* Add support for special ``_id``, ``_score`` and ``_source`` columns. (:issue:`1639`)

#1639

@martint
Copy link
Member

martint commented Oct 4, 2019 

Elasticsearch
* Add support for full text queries. (:issue:`1662`)

#1662

@martint
Copy link
Member

martint commented Oct 4, 2019 •
edited
Loading

  • Extend predicate push-down through identity projections. (:issue:1515)

@sopel39, what's the user-visible impact? Does it improve performance of certain queries? Does it fix a failure? We should describe release notes in those terms.

Same for:

  • Extend predicate push-down through identity projections. (:issue:1515)
  • Remove redundant table scan predicates if they are enforced by connector. (:issue:1516)

@martint
Copy link
Member

martint commented Oct 4, 2019

  • Allow rolling aggregations for window functions. (:issue:464)

@kokosing, can you describe this in terms of the user-visible impact? Improved performance, lower memory requirements, etc? What kinds of queries?

@kokosing
Copy link
Member

kokosing commented Oct 4, 2019

Allow rolling aggregations for window functions. (:issue:464)
@kokosing, can you describe this in terms of the user-visible impact? Improved performance, lower memory requirements, etc? What kinds of queries?

  • Improve performance of certain window functions that are using defined closed window (ROWS BETWEEN ... PRECEDING AND ... FOLLOWING). (:issue:464)

@martint Is it now better?

@sopel39
Copy link
Member

sopel39 commented Oct 4, 2019

@martint

Extend predicate push-down through identity projections.

Improve query performance by extending partitions pruning in queries that contain identity projections and complex predicates.

Remove redundant table scan predicates if they are enforced by connector.

Improve performance by removing redundant table scan predicates which are enforced by connector.

@martint martint mentioned this issue Oct 5, 2019
Merged
@electrum
Copy link
Member Author

electrum commented Oct 5, 2019 

CLI Changes
----

* Add multi-line editing and syntax highlighting. (:issue:`1380`)

#1380

@electrum
Copy link
Member Author

electrum commented Oct 5, 2019 

JDBC Driver Changes
---

* Warnings for queries are now available exclusively via ``Statement``, not ``ResultSet``. (issue:`1640`)

#1640

@electrum
Copy link
Member Author

electrum commented Oct 5, 2019 

Hive Connector Changes
---

* Add separate configuration property ``hive.hdfs.socks-proxy`` for accessing HDFS via a SOCKS proxy. Previously,
  it was controlled with the ``hive.metastore.thrift.client.socks-proxy`` configuration property. (:issue:`1469`)

#1469

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
release-notes
Milestone
320
Development

Successfully merging a pull request may close this issue.

Add 320 release notes martint/trino
5 participants
@electrum @martint @findepi @sopel39 @kokosing