Skip to content

Commit

Permalink
use WizardLM also for GPU
Browse files Browse the repository at this point in the history
  • Loading branch information
Schnitzel committed Aug 17, 2023
1 parent 7475716 commit ed5b864
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions gpu.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
ARG CUDA_IMAGE="12.1.1-devel-ubuntu22.04"
FROM nvidia/cuda:${CUDA_IMAGE}
ENV MODEL=WizardLM-13B-V1.2

# Install the package
RUN apt-get update && apt-get upgrade -y \
Expand All @@ -17,9 +18,6 @@ RUN python3 -m pip install --upgrade pip pytest cmake scikit-build setuptools fa

RUN CMAKE_ARGS="-DLLAMA_CUBLAS=on" FORCE_CMAKE=1 pip install llama-cpp-python

# Run the server
ENV MODEL=vicuna-13B-v1.5-16K-GGML

# Set a working directory for better clarity
WORKDIR /app

Expand Down

0 comments on commit ed5b864

Please sign in to comment.