From d82aacc37c282f44b3eaf3a125c4e527575327ec Mon Sep 17 00:00:00 2001 From: Michael Louis Date: Wed, 17 Jul 2024 10:35:04 -0400 Subject: [PATCH] Add docker image --- docs/source/serving/deploying_with_cerebrium.rst | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/source/serving/deploying_with_cerebrium.rst b/docs/source/serving/deploying_with_cerebrium.rst index ff0ac911108c4..9585b6ef5cb38 100644 --- a/docs/source/serving/deploying_with_cerebrium.rst +++ b/docs/source/serving/deploying_with_cerebrium.rst @@ -28,6 +28,9 @@ Next, to install the required packages, add the following to your cerebrium.toml .. code-block:: toml + [cerebrium.deployment] + docker_base_image_url = "nvidia/cuda:12.1.1-runtime-ubuntu22.04" + [cerebrium.dependencies.pip] vllm = "latest"