Skip to content

3.4.1.0.0.1

Latest
Latest
Compare
Choose a tag to compare
@yanhaizhongyu yanhaizhongyu released this 28 Jan 08:41
v3.4.1.0.0.1
4cf7100
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Added

  • Introduced fs.oci.io.write.allow.overwrite property to manage overwrite behavior during write operations.

  • Added support for using CRC32c (composite-crc32c) during file uploads via the HDFS Connector. Users can enable this by setting fs.checksum.combine.mode property in core-site.xml to COMPOSITE_CRC.

  • Implemented getFileChecksum() API to provide the CRC32c checksum of an object, supporting data integrity verification for DistCP operations.

Removed

  • Removed the deprecated fs.oci.io.write.multipart.overwrite property in favor of the newly introduced fs.oci.io.write.allow.overwrite property.

Changed

  • Updated OCI Java SDK to version 3.55.0 to enable checksum support. This update also removes BouncyCastle dependencies, and changes have been made in the connector to ensure compatibility.

Fixed

  • Addressed potential issues with internal retries in the HDFS Connector's output stream. The new retrier ensures that retries do not result in a 412 Precondition Failed error when the application assumes the object does not already exist.

  • Retrier behavior is now aligned with the allowoverwrite property passed from the OpenOutputStream method to API calls.

File Checksums (SHA256)

oci-hdfs.zip d25330af4a6a5210c55feca62987983de344c59f90fbb586f965d0a6016f3fab
oci-hdfs-individual-modules.zip d6f3c4297f200330305c9e21e7ebbb9af7a037680512b008a5a85a6d0cd8fa3d

Assets 4
Loading