Skip to content

Commit

Permalink
Copy python/pyspark to ${SPARK_HOME}/python/pyspark to make bin/pyspa…
Browse files Browse the repository at this point in the history
…rk work properly in in Docker container
  • Loading branch information
AzureQ committed Nov 14, 2018
1 parent 922dfe4 commit c2f782b
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ RUN apk add --no-cache python && \
# Removed the .cache to save space
rm -r /root/.cache

COPY python/pyspark ${SPARK_HOME}/python/pyspark
COPY python/lib ${SPARK_HOME}/python/lib
ENV PYTHONPATH ${SPARK_HOME}/python/lib/pyspark.zip:${SPARK_HOME}/python/lib/py4j-*.zip

Expand Down

0 comments on commit c2f782b

Please sign in to comment.