Skip to content

Commit

Permalink
[HUDI-4549] Remove avro from hudi-hive-sync-bundle and hudi-aws-bundle (
Browse files Browse the repository at this point in the history
apache#6472)

* Remove avro shading from hudi-hive-sync-bundle
   and hudi-aws-bundle.

Co-authored-by: Raymond Xu <2701446+xushiyan@users.noreply.github.com>

(cherry picked from commit 71fc8b2)
  • Loading branch information
codope authored and neverdizzy committed Dec 1, 2022
1 parent 53e61d1 commit e71c59e
Showing 1 changed file with 2 additions and 17 deletions.
19 changes: 2 additions & 17 deletions packaging/hudi-aws-bundle/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,6 @@
<include>org.apache.hudi:hudi-hive-sync</include>
<include>org.apache.hudi:hudi-aws</include>
<include>org.apache.parquet:parquet-avro</include>
<include>org.apache.avro:avro</include>
<include>com.amazonaws:dynamodb-lock-client</include>
<include>com.amazonaws:aws-java-sdk-cloudwatch</include>
<include>com.amazonaws:aws-java-sdk-dynamodb</include>
Expand Down Expand Up @@ -142,14 +141,6 @@
<pattern>com.amazonaws.</pattern>
<shadedPattern>org.apache.hudi.com.amazonaws.</shadedPattern>
</relocation>
<relocation>
<pattern>org.apache.parquet.avro.</pattern>
<shadedPattern>org.apache.hudi.org.apache.parquet.avro.</shadedPattern>
</relocation>
<relocation>
<pattern>org.apache.avro.</pattern>
<shadedPattern>org.apache.hudi.org.apache.avro.</shadedPattern>
</relocation>
<relocation>
<pattern>com.codahale.metrics.</pattern>
<shadedPattern>org.apache.hudi.com.codahale.metrics.</shadedPattern>
Expand Down Expand Up @@ -284,19 +275,13 @@
<artifactId>hudi-aws</artifactId>
<version>${project.version}</version>
</dependency>
<!-- Need parquet and avro to run AwsGlueCatalogSyncTool using run_sync_tool with this bundle.
Parquet and avro from other packages have already been shaded above-->

<!-- Parquet -->
<dependency>
<groupId>org.apache.parquet</groupId>
<artifactId>parquet-avro</artifactId>
<version>${parquet.version}</version>
<scope>compile</scope>
</dependency>
<dependency>
<groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId>
<version>${avro.version}</version>
<scope>compile</scope>
</dependency>
</dependencies>
</project>

0 comments on commit e71c59e

Please sign in to comment.