Skip to content

Commit

Permalink
Update CHANGELOG for 6.4.0 release.
Browse files Browse the repository at this point in the history
  • Loading branch information
bsharifi authored Dec 3, 2024
1 parent cc77ad9 commit 2a46133
Showing 1 changed file with 14 additions and 0 deletions.
14 changes: 14 additions & 0 deletions CHANGELOG
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,20 @@

# spark-redshift Changelog

## 6.4.0 (2024-12-02)
- Supports utilizing the Redshift Data API as an alternative mechanism for communicating with Redshift (see parameters "data_api_*" in the README). [Beaux Sharifi]
- Adds DML pushdown support for four Spark SQL operators: INSERT, DELETE, UPDATE, and MERGE. [Hari Kishore Chaparala, Ruei Yang Huang, Xiaoxuan Li, Beaux Sharifi, Brooke White]
- Adds new pushdown support for the following Spark operators: LocalRelation, CreateNamedStruct, Intersect, and Except [Hari Kishore Chaparala, Xiaoxuan Li, Beaux Sharifi]
- Enhances InSubQuery pushdown to support multiple values. [Beaux Sharifi]
- Adds pushdown support for join conditions [Beaux Sharifi, Brooke White]
- Adds sub-field pushdown support to child scalar subqueries. [Beaux Sharifi]
- Converts left semi and left anti joins into intersect and except set operations in some conditions to improve pushdown performance. [Hari Kishore Chaparala]
- Reverses readSidePadding Spark optimization rule to improve pushdown performance. [Atul Payapilly]
- Adds parameter "check_s3_bucket_usage" for disabling S3 bucket checks during operation to reduce network calls. [Armin Najafi]
- Abbreviates generated pushdown SQL for accommodating Redshift Data API’s smaller maximum query length. [Jack Ye]
- Strengthens logic for detecting and preventing cross-cluster pushdowns. [Beaux Sharifi]
- Validates connector tests pass with the latest Spark patch releases 3.3.4, 3.4.4, and 3.5.3 [Beaux Sharifi]

## 6.3.0 (2024-07-03)
- Validates connector tests pass with Spark releases 3.4.3 and 3.5.1 [Beaux Sharifi]
- Adds support for three-part table names to allow connector to query Redshift data sharing tables (#153) [Prashant Singh, Beaux Sharifi]
Expand Down

0 comments on commit 2a46133

Please sign in to comment.