Skip to content

Commit

Permalink
[SPARK-47160][K8S] Update K8s Dockerfile to include hive-jackson
Browse files Browse the repository at this point in the history
…directory if exists

### What changes were proposed in this pull request?

This PR aims to update K8s `Dockerfile` to include `hive-jackson` jar directory if exists.

### Why are the changes needed?

After SPARK-47152, we can have `hive-jackson` directory.

### Does this PR introduce _any_ user-facing change?

No, this is used by Spark internal by default.

### How was this patch tested?

Pass the CIs and manual check.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#45251 from dongjoon-hyun/SPARK-47160.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
  • Loading branch information
dongjoon-hyun committed Aug 12, 2024
1 parent 384db4d commit 3c756c4
Showing 1 changed file with 2 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -52,6 +52,8 @@ RUN set -ex && \
rm -rf /var/cache/apt/* && rm -rf /var/lib/apt/lists/*

COPY jars /opt/spark/jars
# Copy hive-jackson directory if exists
COPY hive-jackso[n] /opt/spark/hive-jackson
# Copy RELEASE file if exists
COPY RELEAS[E] /opt/spark/RELEASE
COPY bin /opt/spark/bin
Expand Down

0 comments on commit 3c756c4

Please sign in to comment.