From 13f014a043ea0466585e19611fddb4a88c64ffa8 Mon Sep 17 00:00:00 2001 From: Rafael Vasquez Date: Mon, 17 Jun 2024 19:31:11 -0400 Subject: [PATCH] Update docker references Signed-off-by: Rafael Vasquez --- docs/source/dev/dockerfile/dockerfile.rst | 20 +++++++++---------- docs/source/serving/deploying_with_docker.rst | 7 +++---- 2 files changed, 13 insertions(+), 14 deletions(-) diff --git a/docs/source/dev/dockerfile/dockerfile.rst b/docs/source/dev/dockerfile/dockerfile.rst index a07463392dbe8..40ba818eb57d8 100644 --- a/docs/source/dev/dockerfile/dockerfile.rst +++ b/docs/source/dev/dockerfile/dockerfile.rst @@ -2,19 +2,19 @@ Dockerfile ==================== See `here `_ for the main Dockerfile to construct -the image for running an OpenAI compatible server with vLLM. +the image for running an OpenAI compatible server with vLLM. More information about deploying with Docker can be found `here `_. -- Below is a visual representation of the multi-stage Dockerfile. The build graph contains the following nodes: +Below is a visual representation of the multi-stage Dockerfile. The build graph contains the following nodes: - - All build stages - - The default build target (highlighted in grey) - - External images (with dashed borders) +- All build stages +- The default build target (highlighted in grey) +- External images (with dashed borders) - The edges of the build graph represent: - - - FROM ... dependencies (with a solid line and a full arrow head) - - COPY --from=... dependencies (with a dashed line and an empty arrow head) - - RUN --mount=(.*)from=... dependencies (with a dotted line and an empty diamond arrow head) +The edges of the build graph represent: + +- FROM ... dependencies (with a solid line and a full arrow head) +- COPY --from=... dependencies (with a dashed line and an empty arrow head) +- RUN --mount=(.*)from=... dependencies (with a dotted line and an empty diamond arrow head) .. figure:: ../../assets/dev/dockerfile-stages-dependency.png :alt: query diff --git a/docs/source/serving/deploying_with_docker.rst b/docs/source/serving/deploying_with_docker.rst index fa82bc8e3bd33..14d94b09e9b9c 100644 --- a/docs/source/serving/deploying_with_docker.rst +++ b/docs/source/serving/deploying_with_docker.rst @@ -3,9 +3,8 @@ Deploying with Docker ============================ -vLLM offers official docker image for deployment. -The image can be used to run OpenAI compatible server. -The image is available on Docker Hub as `vllm/vllm-openai `_. +vLLM offers an official Docker image for deployment. +The image can be used to run OpenAI compatible server and is available on Docker Hub as `vllm/vllm-openai `_. .. code-block:: console @@ -25,7 +24,7 @@ The image is available on Docker Hub as `vllm/vllm-openai `_. To build vLLM: .. code-block:: console