Skip to content

Commit

Permalink
ODP-2118: Hudi, DeltaLake, Iceberg version upgrade for open table cli…
Browse files Browse the repository at this point in the history
…ent. (#40)

* ODP-2118: Hudi, DeltaLake, Iceberg version upgrade for open table clients.

* ODP-2118: Delta spark version fix

* ODP-2118: delta-spark and iceberg jars scala version fix.

* ODP-2118: iceberg jars scala version fix.
  • Loading branch information
manishsinghmowall authored Sep 18, 2024
1 parent fe26baa commit 458ed79
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 7 deletions.
6 changes: 3 additions & 3 deletions assembly/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -81,19 +81,19 @@
</dependency>
<dependency>
<groupId>io.delta</groupId>
<artifactId>delta-core_${scala.binary.version}</artifactId>
<artifactId>delta-spark_2.12</artifactId>
<version>${deltalake.version}</version>
</dependency>
<dependency>
<groupId>org.apache.hudi</groupId>
<artifactId>hudi-spark3.3-bundle_${scala.binary.version}</artifactId>
<artifactId>hudi-spark3.5-bundle_${scala.binary.version}</artifactId>
<version>${hudi.version}</version>
</dependency>
<!-- Commenting out to avoid Build error "Found Banned Dependency: org.apache.iceberg:iceberg-spark-runtime-3.3_2.12:jar:1.5.0"
-->
<dependency>
<groupId>org.apache.iceberg</groupId>
<artifactId>iceberg-spark-runtime-3.3_${scala.binary.version}</artifactId>
<artifactId>iceberg-spark-runtime-3.5_2.12</artifactId>
<version>${iceberg.version}</version>
</dependency>

Expand Down
8 changes: 4 additions & 4 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -160,9 +160,9 @@
<chill.version>0.10.0</chill.version>
<ivy.version>2.5.2</ivy.version>
<oro.version>2.0.8</oro.version>
<deltalake.version>2.3.0</deltalake.version>
<hudi.version>0.14.2</hudi.version>
<iceberg.version>1.5.0</iceberg.version>
<deltalake.version>3.2.0</deltalake.version>
<hudi.version>0.15.1</hudi.version>
<iceberg.version>1.6.0</iceberg.version>
<!--
If you changes codahale.metrics.version, you also need to change
the link to metrics.dropwizard.io in docs/monitoring.md.
Expand Down Expand Up @@ -2824,7 +2824,7 @@
<exclude>*:*_2.10</exclude>
</excludes>
<includes>
<include>org.apache.iceberg:iceberg-spark-runtime-3.3_2.12:jar:1.5.0</include>
<include>org.apache.iceberg:iceberg-spark-runtime-3.5_2.12:jar:1.5.0</include>
</includes>
<searchTransitive>true</searchTransitive>
</bannedDependencies>
Expand Down

0 comments on commit 458ed79

Please sign in to comment.