Skip to content

Latest commit

 

History

History
199 lines (149 loc) · 7.48 KB

CHANGELOG.md

File metadata and controls

199 lines (149 loc) · 7.48 KB
Raw

Change Log

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog.

3.3.0.0 - 2021-03-16

Added

  • Added metadata caching using the fs.oci.caching.object.metadata.enabled and fs.oci.caching.object.metadata.spec configuration keys. Note that there is no check for consistency, and if your data in Object Storage changes, the cache may return outdated data. Therefore, it is most appropriate when your data is read-only and does not change. Use caution when applying these settings.
  • Added read-ahead and parquet caching. The read-ahead feature is configured using fs.oci.io.read.ahead and fs.oci.io.read.ahead.blocksize. Parquet caching, which requires fs.oci.io.read.ahead=true, is controlled using fs.oci.caching.object.parquet.enabled and fs.oci.caching.object.parquet.spec. Note that there is no check for consistency, and if your data in Object Storage changes, the cache may return outdated data. Therefore, it is most appropriate when your data is read-only and does not change. Use caution when applying these settings.
  • Added Jersey client logging, configured using fs.oci.client.jersey.logging.enabled, fs.oci.client.jersey.logging.level, and fs.oci.client.jersey.logging.verbosity.

Changed

  • Updated to Hadoop version 3.3.0
  • Updated to OCI Java SDK version 1.33.1

3.2.1.3 - 2020-11-03

Changed

  • Updated to OCI Java SDK version 1.25.2

Fixed

  • Fixed a potential data curruption problem with RefreshableOnNotAuthenticatedProvider. We recommend that you update to this version 3.2.1.3 or later. For details, see oracle#35

3.2.1.1 - 2020-09-15

Changed

  • Updated to OCI Java SDK version 1.23.1

3.2.1.0 - 2020-09-01

Changed

  • Updated to Hadoop version 3.2.1
  • Updated to OCI Java SDK version 1.22.1

2.9.2.7 - 2020-08-11

Added

  • Release incorporates hdfs-full module.

Changed

  • Updated to OCI Java SDK version 1.22.0

2.9.2.6 - 2020-06-02

Changed

  • Updated to OCI Java SDK version 1.17.5

2.9.2.5 - 2020-05-05

Changed

  • Updated to OCI Java SDK version 1.17.0

Added

  • Added DelayStrategy that resets the exponential backoff between retries after reaching a maximum time, configuratble using fs.oraclebmc.client.retry.reset.threshold.seconds

2.9.2.4 - 2019-03-12

Changed

  • Updated to Java SDK version 1.14.0

2.9.2.1 - 2019-08-27

Changed

  • Updated to Java SDK version 1.6.2

2.9.2.0 - 2019-08-13

Changed

  • Updated version number to stem from Hadoop version 2.9.2

Fixed

  • Fix race condition in BmcFileBackedOutputStream#createBufferFile

2.7.7.3 - 2019-07-09

Added

  • Support for retries upon failures. Retry timeout is configurable via fs.oci.client.retry.timeout.seconds

Changed

  • Updated to Java SDK version 1.5.12

2.7.7.2 - 2019-03-19

Fixed

  • BmcDirectFSInputStream#read now attempts to retry the read from the service when an IOException is thrown

Changed

  • Updated to Java SDK version 1.4.2

2.7.7.1 - 2018-12-13

Changed

  • Added relocation for shaded packages javax.annotation, javax.validation and javax.inject

2.7.7.0 - 2018-11-01

Changed

  • Updated version number to stem from Hadoop version 2.7.7
  • Updated to latest Java SDK (1.2.49) to leverage the updated Object Storage UploadManager with HTTP proxy support
  • The configuration option of MULTIPART_MIN_PART_SIZE_IN_MB is now deprecated in favor of MULTIPART_PART_SIZE_IN_MB to correspond with the configuration changes for the UploadManager in the java SDK
  • Bouncy castle and JSR-305 jars are no longer bundled within the distribution jar and now must be included in the Hadoop CLASSPATH. Required third party jars are bundled under the third-party/lib folder of the distribution zip archive

Added

  • Support for configuring an HTTP proxy. More information can be found here

2.7.2.2 - 2018-07-12

Fixed

  • Disabled caching of stale key id and private key in the InstancePrincipalsCustomAuthenticator class

Changed

  • Updated to latest Java SDK (1.2.42) to pick up bug fixes

2.7.2.1 - 2018-06-28

Fixed

  • Enabled progress reporting to Application Master during upload operation
  • Enabled usage in a Hadoop deployment with kerberos

Changed

  • Updated to latest Java SDK (1.2.41) to pick up bug fixes

2.7.2.0 - 2018-04-05

Fixed

  • Added build instruction and fixed broken GitHub links in README

Changed

  • Updated version number to stem from Hadoop version 2.7.2

1.2.10 - 2018-03-27

Changed

Added

  • Support instance principals authentication

1.2.7 - 2017-12-11

Changed

  • Replaced copy+delete rename operation with renameObject to improve performance

1.2.6 - 2017-11-27

Fixed

  • Fetching the private key password now uses 'getPassword' from the Configuration instead of getting the string in plaintext

Added

  • Added ability to override configuration based on bucket and namespace being accessed

1.2.5 - 2017-09-11

Changed

  • Maven packages renamed from "oracle-bmc-" to "oci-"" (group id renamed from "com.oracle.bmc.sdk" to "com.oracle.oci.sdk")
  • Renamed configuration properties (from "oraclebmc" to "oci"); old properties are deprecated (see "Deprecated" below).
  • Renamed HDFS scheme (from "oraclebmc" to "oci"); old scheme is deprecated (see "Deprecated" below).
  • HTTP user agent changed from "Oracle-BMC_HDFS_Connector/" to "Oracle-HDFS_Connector/"

Deprecated

  • The old configuration properties ("oraclebmc") are deprecated; please use ("oci") instead. The old properties still work for backward compatibility, as long as the corresponding new property isn't set at the same time.
  • The old HDFS scheme ("oraclebmc") is deprecated; please use "oci" instead. The old scheme still works for backward compatibility.

1.2.3 - 2017-04-06

Fixed

  • Updated to latest Java SDK (1.2.5) to pick up change for request id truncation (to fix multipart uploads)

Changed

  • Changed properties and constants to allow for more useful documentation
  • Updated maven shade plugin to non-snapshot version

1.2.2 - 2017-03-28

Changed

  • Internal changes for how properties are loaded

Added

  • Support to use multi-part uploads when saving files
  • Configuration options to tune multi-part upload behavior (or disable it)

1.2.1 - 2017-03-16

Fixed

  • Bug in directory listing resulting in duplicate directories
  • Concurrency issue when creating directory placeholders

Changed

  • Improved "list directory" performance for large directories

1.2.0 - 2016-12-16

Fixed

  • Using correct Date header for object creation time
  • Bug with seek operation

Changed

  • Updated to Oracle Cloud Infrastructure Java SDK 1.2.0
  • Shading a few more dependencies (h2k)
  • Doc updates

Added

  • Abstract Filesystem to support usagage within Yarn and Spark

1.1.0 - 2016-11-18

Fixed

  • Updated to Oracle BMCS Java SDK 1.1.0 to pick up bug fixes

Added

  • License/copyright headers added to all source files as part of the build
  • Now relocating shaded packages for Bouncycastle, Apache Commons, Glassfish

1.0.1 - 2016-11-15

Fixed

  • Updated to Oracle Cloud Infrastructure Java SDK 1.0.1 to pick up bug fixes

Added

  • Including MD5 validation during copy operations

1.0.0 - 2016-10-20

Added

  • Initial Release
  • Support added for Hadoop 2.7.2 using Oracle Cloud Infrastructure Services Java SDK 1.0.0