Skip to content

Commit

Permalink
[SPARK-49861][INFRA] Add Python 3.13 to Infra docker image
Browse files Browse the repository at this point in the history
  • Loading branch information
dongjoon-hyun committed Oct 2, 2024
1 parent d97acc1 commit 81975cc
Showing 1 changed file with 10 additions and 0 deletions.
10 changes: 10 additions & 0 deletions dev/infra/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -142,6 +142,16 @@ RUN python3.12 -m pip install $BASIC_PIP_PKGS $CONNECT_PIP_PKGS lxml && \
python3.12 -m pip install torcheval && \
python3.12 -m pip cache purge

# Install Python 3.13 at the last stage to avoid breaking the existing Python installations
RUN apt-get update && apt-get install -y \
python3.13 \
&& rm -rf /var/lib/apt/lists/*
RUN curl -sS https://bootstrap.pypa.io/get-pip.py | python3.13
# TODO(SPARK-49862) Add BASIC_PIP_PKGS and CONNECT_PIP_PKGS to Python 3.13 image when it supports Python 3.13
RUN python3.13 -m pip install --ignore-installed blinker>=1.6.2 # mlflow needs this
RUN python3.13 -m pip install unittest-xml-reporting lxml && \
python3.13 -m pip cache purge

# Remove unused installation packages to free up disk space
RUN apt-get remove --purge -y 'gfortran-11' 'humanity-icon-theme' 'nodejs-doc' || true
RUN apt-get autoremove --purge -y
Expand Down

0 comments on commit 81975cc

Please sign in to comment.