Delta Sharing 0.6.3

We’d like to announce the release of Delta Sharing 0.6.3, which introduces the following improvement and bug fixes.

Improvements:

• Support jsonPredicateHints in delta sharing protocol, and support it in spark connector. (#253, #255, #256, #257, #258, #264, #270, #272, #273, #274)
• Add UUIDs as Table IDs on the reference server. (#262, #263, #267)
• Support more flexible timestamp options in spark (#231)
• Fix typo of start_version in load_table_changes_as_spark in README (#249)

Credits: Abhijit Chakankar, Lin Zhou, Xiaotong Sun

Delta Sharing 0.5.4

We’d like to announce the release of Delta Sharing 0.5.4, which introduces the following bug fixes.
Bug fixes:

• Spark connector changes to consume size from metadata. (#244)

Credits: Abhijit Chakankar, Lin Zhou

Delta Sharing 0.5.3

We’d like to announce the release of Delta Sharing 0.5.3, which introduces the following bug fixes.

Bug fixes:

• Extends DeltaSharingProfileProvider to customize tablePath and refresher (#225)
• Refresh pre-signed urls for cdf queries (#226)
• Fix partitionFilters issue for cdf queries. (#230)
• Fix comparison of the expiration time to current time for pre-signed urls.(#237)

Credits: Abhijit Chakankar, Lin Zhou, William Chau

Delta Sharing 0.6.2

We’d like to announce the release of Delta Sharing 0.6.2, which introduces the following improvement and bug fixes.

Bug fixes:

• Fix comparison of the expiration time to current time for pre-signed urls.(#236)

Credits: Lin Zhou, William Chau

Delta Sharing 0.6.1

We’d like to announce the release of Delta Sharing 0.6.1, which introduces the following improvement and bug fixes.

Improvements:

• Spark connector changes to consume size from metadata. (#228)
• Improve delta sharing error messages(#235)

Bug fixes:

• Extends DeltaSharingProfileProvider to customize tablePath and refresher (#223)
• Refresh pre-signed urls for cdf and streaming queries (#221, #222)
• Allow 0 for versionAsOf parameter, to be consistent with Delta (#224)
• Fix partitionFilters issue: apply it to all file indices. (#227, #229)

Credits: Abhijit Chakankar, Lin Zhou

Delta Sharing 0.6.0

We are excited to announce the release of Delta Sharing 0.6.0, which introduces the following improvements.

Improvements:

• Support using a delta sharing table as a source in spark structured streaming, which allows recipients to stay up to date with the shared data. (#189, #190, #194, #195, #198, #199, #200, #201, #204, #205, #207, #208, #209, #211, #212, #214, #216, #217, #218, #219)
• Fix a few nits in the PROTOCOL documentation (#213)
• Support timestampAsOf parameter in delta sharing data source. (#186, #187, #188)

Credits: Abhijit Chakankar, Lin Zhou, Xiaotong Sun

Delta Sharing 0.5.2

Delta Sharing 0.5.2 has one single change that adds ability to override HTTP headers included in the request to the Delta Sharing server.

• Add a Custom Http Header Provider (#192)

Credits: Xiaotong Sun

Delta Sharing 0.5.1

We are excited to announce the release of Delta Sharing 0.5.1, which introduces the following changes.

Improvements:

• Upgrade AWS SDK to 1.12.189 (#170)
• More tests on the error message when loading table fails (#164)
• Add ability to configure armeria server request timeout (#163)
• documentation improvements (#171, #179)

Bug fixes:

• Fix column selection bug on Delta Sharing CDF spark dataframe (#184)
• Fix GCS path reading (#181)

Credits: Antonio Irizarry, Lin Zhou, Shixiong Zhu, Pat McCauley

Delta Sharing 0.5.0

We are excited to announce the release of Delta Sharing 0.5.0, which introduces the following improvements.

Improvements:

• Support for Change Data Feed which allows clients to fetch incremental changes for the shared tables. (#135, #136, #137, #138, #140, #141, #142, #145, #146, #147, #148, #149, #150, #151, #152, #153, #155, #159)
• Include response body in HTTPError exception in Python library (#124)
• Improve the error message for the /share/schema/table APIs (#120)
• Protocol and REST API documentation improvements (#121, #128, #131)
• Add query_table_version to the rest client (#111)

Credits: Abhijit Chakankar, Alex Ott, Lin Zhou, Shixiong Zhu, William Chau, Xiaotong Sun, harksin, Kohei Toshimitsu, Vuong Nguyen

Delta Sharing 0.4.0

We are excited to announce the release of Delta Sharing 0.4.0, which introduces the following improvements and fixes.

Improvements:

• Support Google Cloud Storage on Delta Sharing Server (#81, #105)
• Add a new API to get the metadata of a Share (#97)
• Protocol and REST API documentation enhancements (#85, #89, #93, #98)
• Allow for customization of recipient profile in Apache Spark connector (#99, #107)

Bug fixes:

• Block managed table creation for Delta Sharing to prevent user confusions (#92)

Credits: Denny Lee, Lin Zhou, Shixiong Zhu, William Chau, Xiaotong Sun, Kohei Toshimitsu