0.9.2

A maintenance release.

• Bump jackson libraries to 2.12.7 (#166)

0.9.1

A maintenance release.

• Bump snowflake-jdbc to 3.13.15 (#162)

0.9.0

Modernization and improvement of Transformer.

Enchancements

• Remove s3committer in Transformer (#158)
• Disable caching in TransformJob (#157)
• Bump Spark to 3.2.1 (#155)

Under the hood

• Use sbt-dynver plugin (#161)
• Extend copyright notice to 2021 (#160)
• Bump sbt to 1.5.5 (#156)

0.8.2 (2021-08-23)

A maintenance release the bumps dependencies to their latest versions.

• Bump jackson-dataformat-cbor to 2.11.4 (#152)
• Remove bintray and oss snapshots resolvers (#151)
• Bump iglu-scala-client to 1.1.1 (#150)
• Bump snowplow-badrows to 2.1.1 (#149)

0.8.1 (2021-06-25)

Bugfixes

• Use non-AWS endpoints in host inference (#131)
• Rename the userAgent JDBC connection property to application (#132)
• Extend se_label to 4096 characters (#134)

Dependency bumps

• Bump circe to 0.14.1 (#143)
• Bump decline to 1.4.0 (#139)
• Bump enumeratum to 1.7.0 (#141)
• Bump fs2-core to 2.5.6 (#138)
• Bump jackson-databind to 2.9.10.7 (#144)
• Bump scalacheck to 1.15.4 (#146)
• Bump snowflake-jdbc to 3.13.5 (#147)
• Bump specs2 to 4.12.0 (#145)
• Bump snowplow-scala-analytics-sdk to 2.1.0 (#140)
• Bump schema-ddl to 0.13.0 (#142)

Under the hood

• Migrate from Travis to Github Actions (#135)
• Attach jar files to Github releases (#136)

0.4.3 (2020-12-22)

This is a maintenance release, branching off the regular upgrade path, to allow mixed use of Transformer 0.4.x and Loader 0.8.0 via a single configuration file when storageIntegration authentication method is in use.

If you are on 0.4.2 and want to upgrade, we recommend you skip this version and follow the usual upgrade path where the latest version at the time of this release is 0.8.0.

CHANGELOG

Make Transformer 0.4.x compatible with 0.8.0 config (#129)

0.8.0 (2020-10-06)

EMR 6, Spark 3, vulnerable libraries fixes and proper VARCHAR truncation.

• Discourse post

New features

• Add extensive logging (#120)
• Bump Scala to 2.12 (#119)

Bug fixes

• Truncate long VARCHAR fields before casting (#126)
• Fix YARN timeout exception (#124)
• Fix jackson-databind version to 2.9.10.6 (#123)
• Fix Snyk integration (#115)

Documentation

• Point README links to documentation website (#122)
• Fix sbt version bump in CHANGELOG (#118)

0.7.1 (2020-09-17)

A bugfix release, improving memory consumption.

Bugfixes

• Avoid loading whole DynamoDB manifest into memory (#116)

0.7.0 (2020-08-24)

0.7.0 introduces support for Snowflake Storage Integrations, bumps snowflake-jdbc driver to 3.12.10, integrates snyk and more under-the-hood improvements.

• Integrate Snyk (#112)
• Add Snyk credentials to .travis.yml (#113)
• Add authentication support for storage integration (#106)
• Update default JDBC host (#102)
• Fix sbt-dynamodb usage (#111)
• Bump SBT to 1.3.13 (#110)
• Bump snowflake-jdbc to 3.12.10 (#109)

Version 0.6.0 (2020-01-31)

A long-standing truncation fix with a lot of internal improvements.

• Discourse post

Improvements

• Bump Snowflake JDBC driver to 3.11.0 (#69)

Bugfixes

• Truncate long VARCHAR fields on loading (#99)

Under the hood

• Switch to tagless final API (#95)
• Replace scopt with decline (#93)
• Extend copyright notice to 2020 (#96)
• Remove vagrant setup (#89)
• Add test specification for ProcessManifest (#97)