[Installation]: cannot install vllm quick start using dockerfile with openvino backend

[7SKWL5]

Your current environment

The output of `python collect_env.py`
Failed to build msgspec
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (msgspec)

How you are installing vllm

docker build -f Dockerfile.openvino -t vllm-openvino-env .
[+] Building 295.0s (11/14)                                                                                                                                                                                                    docker:default
 => [internal] load build definition from Dockerfile.openvino                                                                                                                                                                            0.1s
 => => transferring dockerfile: 1.05kB                                                                                                                                                                                                   0.0s
 => [internal] load metadata for docker.io/library/ubuntu:22.04                                                                                                                                                                          0.7s
 => [internal] load .dockerignore                                                                                                                                                                                                        0.0s
 => => transferring context: 446B                                                                                                                                                                                                        0.0s
 => [dev  1/10] FROM docker.io/library/ubuntu:22.04@sha256:0e5e4a57c2499249aafc3b40fcd541e9a456aab7296681a3994d631587203f97                                                                                                              0.0s
 => [internal] load build context                                                                                                                                                                                                        0.2s
 => => transferring context: 213.52kB                                                                                                                                                                                                    0.1s
 => CACHED [dev  2/10] RUN apt-get update -y &&     apt-get install -y         git python3-pip         ffmpeg libsm6 libxext6 libgl1                                                                                                     0.0s
 => CACHED [dev  3/10] WORKDIR /workspace                                                                                                                                                                                                0.0s
 => CACHED [dev  4/10] COPY . .                                                                                                                                                                                                          0.0s
 => CACHED [dev  5/10] RUN --mount=type=bind,source=.git,target=.git     if [ "0" != 0 ]; then bash tools/check_repo.sh ; fi                                                                                                             0.0s
 => CACHED [dev  6/10] RUN PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu" python3 -m pip install -r /workspace/requirements-build.txt                                                                                        0.0s
 => ERROR [dev  7/10] RUN PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu" VLLM_TARGET_DEVICE="openvino" python3 -m pip install /workspace                                                                                   293.9s
------                                                                                                                                                                                                                                        
 > [dev  7/10] RUN PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu" VLLM_TARGET_DEVICE="openvino" python3 -m pip install /workspace:                                                                                                
0.908 Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cpu                                                                                                                                                       
0.924 Processing /workspace                                                                                                                                                                                                                   
1.308   Installing build dependencies: started                                                                                                                                                                                                
39.67   Installing build dependencies: finished with status 'done'                                                                                                                                                                            
39.68   Getting requirements to build wheel: started
43.60   Getting requirements to build wheel: finished with status 'done'
43.61   Preparing metadata (pyproject.toml): started
46.60   Preparing metadata (pyproject.toml): finished with status 'done'
46.66 Collecting optimum-intel[nncf]@ git+https://github.com/huggingface/optimum-intel.git@main
46.66   Cloning https://github.com/huggingface/optimum-intel.git (to revision main) to /tmp/pip-install-blx0cev2/optimum-intel_67a56fc3d9c1410586c78482e0c58b54
46.66   Running command git clone --filter=blob:none --quiet https://github.com/huggingface/optimum-intel.git /tmp/pip-install-blx0cev2/optimum-intel_67a56fc3d9c1410586c78482e0c58b54
48.73   Resolved https://github.com/huggingface/optimum-intel.git to commit ea6fa42d2ba778c81c6b70dc2dc9e92b4af1c74d
48.91   Installing build dependencies: started
53.56   Installing build dependencies: finished with status 'done'
53.57   Getting requirements to build wheel: started
53.80   Getting requirements to build wheel: finished with status 'done'
53.80   Preparing metadata (pyproject.toml): started
54.09   Preparing metadata (pyproject.toml): finished with status 'done'
54.11 Collecting optimum@ git+https://github.com/huggingface/optimum.git@main
54.11   Cloning https://github.com/huggingface/optimum.git (to revision main) to /tmp/pip-install-blx0cev2/optimum_64266fd8170b442aa7e92dea850bac31
54.11   Running command git clone --filter=blob:none --quiet https://github.com/huggingface/optimum.git /tmp/pip-install-blx0cev2/optimum_64266fd8170b442aa7e92dea850bac31
55.87   Resolved https://github.com/huggingface/optimum.git to commit d21256c2964945fc3fe4623f7befb21082b69a25
56.05   Installing build dependencies: started
60.68   Installing build dependencies: finished with status 'done'
60.69   Getting requirements to build wheel: started
60.99   Getting requirements to build wheel: finished with status 'done'
61.00   Preparing metadata (pyproject.toml): started
61.36   Preparing metadata (pyproject.toml): finished with status 'done'
61.87 Collecting partial-json-parser
62.00   Downloading partial_json_parser-0.2.1.1.post4-py3-none-any.whl (9.9 kB)
63.10 Collecting pyzmq
63.12   Downloading pyzmq-26.2.0-cp310-cp310-manylinux_2_28_x86_64.whl (868 kB)
63.22      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 868.8/868.8 KB 9.3 MB/s eta 0:00:00
64.14 Collecting tokenizers>=0.19.1
64.16   Downloading tokenizers-0.21.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
64.33      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 18.8 MB/s eta 0:00:00
64.84 Collecting gguf==0.10.0
64.86   Downloading gguf-0.10.0-py3-none-any.whl (71 kB)
64.87      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71.6/71.6 KB 8.6 MB/s eta 0:00:00
65.80 Collecting numpy<2.0.0
65.81   Downloading numpy-1.26.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB)
66.69      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18.2/18.2 MB 19.0 MB/s eta 0:00:00
66.77 Requirement already satisfied: torch==2.5.1 in /usr/local/lib/python3.10/dist-packages (from vllm==0.6.6.dev44+gc2d1b075.openvino) (2.5.1+cpu)
67.21 Collecting blake3
67.23   Downloading blake3-1.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (367 kB)
67.25      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 367.3/367.3 KB 19.7 MB/s eta 0:00:00
67.91 Collecting msgspec
67.93   Downloading msgspec-0.18.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (210 kB)
67.94      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 210.3/210.3 KB 21.6 MB/s eta 0:00:00
68.33 Collecting prometheus-client>=0.18.0
68.35   Downloading prometheus_client-0.21.1-py3-none-any.whl (54 kB)
68.36      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.7/54.7 KB 8.3 MB/s eta 0:00:00
68.84 Collecting pyyaml
68.86   Downloading PyYAML-6.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (751 kB)
68.90      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 751.2/751.2 KB 19.3 MB/s eta 0:00:00
70.49 Collecting aiohttp
70.50   Downloading aiohttp-3.11.11-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
70.59      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 18.5 MB/s eta 0:00:00
71.20 Collecting sentencepiece
71.21   Downloading sentencepiece-0.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
71.29      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 19.3 MB/s eta 0:00:00
71.73 Collecting uvicorn[standard]
71.75   Downloading uvicorn-0.34.0-py3-none-any.whl (62 kB)
71.77      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.3/62.3 KB 5.0 MB/s eta 0:00:00
72.21 Collecting lark==1.2.2
72.23   Downloading lark-1.2.2-py3-none-any.whl (111 kB)
72.24      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 111.0/111.0 KB 14.7 MB/s eta 0:00:00
72.48 Collecting mistral-common[opencv]>=1.5.0
72.50   Downloading mistral_common-1.5.1-py3-none-any.whl (6.5 MB)
72.81      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.5/6.5 MB 21.9 MB/s eta 0:00:00
73.56 Collecting pydantic>=2.9
73.58   Downloading pydantic-2.10.4-py3-none-any.whl (431 kB)
73.61      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 431.8/431.8 KB 16.6 MB/s eta 0:00:00
74.09 Collecting requests>=2.26.0
74.11   Downloading requests-2.32.3-py3-none-any.whl (64 kB)
74.12      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.9/64.9 KB 9.5 MB/s eta 0:00:00
74.70 Collecting openai>=1.52.0
74.71   Downloading openai-1.58.1-py3-none-any.whl (454 kB)
74.74      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 454.3/454.3 KB 18.4 MB/s eta 0:00:00
75.22 Collecting importlib-metadata
75.23   Downloading importlib_metadata-8.5.0-py3-none-any.whl (26 kB)
75.71 Collecting compressed-tensors==0.8.1
75.73   Downloading compressed_tensors-0.8.1-py3-none-any.whl (87 kB)
75.74      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 KB 11.1 MB/s eta 0:00:00
76.22 Collecting einops
76.23   Downloading einops-0.8.0-py3-none-any.whl (43 kB)
76.25      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.2/43.2 KB 3.0 MB/s eta 0:00:00
76.74 Collecting outlines==0.1.11
76.76   Downloading outlines-0.1.11-py3-none-any.whl (87 kB)
76.77      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.6/87.6 KB 10.2 MB/s eta 0:00:00
77.35 Collecting lm-format-enforcer<0.11,>=0.10.9
77.37   Downloading lm_format_enforcer-0.10.9-py3-none-any.whl (43 kB)
77.38      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.9/43.9 KB 5.4 MB/s eta 0:00:00
77.88 Collecting tqdm
77.90   Downloading tqdm-4.67.1-py3-none-any.whl (78 kB)
77.90      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.5/78.5 KB 10.8 MB/s eta 0:00:00
77.91 Requirement already satisfied: typing-extensions>=4.10 in /usr/local/lib/python3.10/dist-packages (from vllm==0.6.6.dev44+gc2d1b075.openvino) (4.12.2)
77.91 Requirement already satisfied: filelock>=3.16.1 in /usr/local/lib/python3.10/dist-packages (from vllm==0.6.6.dev44+gc2d1b075.openvino) (3.16.1)
78.47 Collecting tiktoken>=0.6.0
78.49   Downloading tiktoken-0.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
78.54      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 21.7 MB/s eta 0:00:00
78.98 Collecting cloudpickle
79.00   Downloading cloudpickle-3.1.0-py3-none-any.whl (22 kB)
79.95 Collecting pillow
79.97   Downloading pillow-11.0.0-cp310-cp310-manylinux_2_28_x86_64.whl (4.4 MB)
80.17      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 21.5 MB/s eta 0:00:00
80.72 Collecting py-cpuinfo
80.74   Downloading py_cpuinfo-9.0.0-py3-none-any.whl (22 kB)
81.34 Collecting psutil
81.36   Downloading psutil-6.1.1-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (287 kB)
81.38      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 287.5/287.5 KB 14.9 MB/s eta 0:00:00
81.86 Collecting prometheus-fastapi-instrumentator>=7.0.0
81.88   Downloading prometheus_fastapi_instrumentator-7.0.0-py3-none-any.whl (19 kB)
82.47 Collecting openvino>=2024.4.0
82.48   Downloading openvino-2024.6.0-17404-cp310-cp310-manylinux2014_x86_64.whl (44.7 MB)
84.56      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.7/44.7 MB 16.0 MB/s eta 0:00:00
85.16 Collecting fastapi!=0.113.*,!=0.114.0,>=0.107.0
85.18   Downloading fastapi-0.115.6-py3-none-any.whl (94 kB)
85.20      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94.8/94.8 KB 10.4 MB/s eta 0:00:00
85.64 Collecting depyf==0.18.0
85.65   Downloading depyf-0.18.0-py3-none-any.whl (38 kB)
86.15 Collecting xgrammar>=0.1.6
86.17   Downloading xgrammar-0.1.7-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (332 kB)
86.19      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 332.3/332.3 KB 17.4 MB/s eta 0:00:00
86.68 Collecting transformers>=4.45.2
86.70   Downloading transformers-4.47.1-py3-none-any.whl (10.1 MB)
87.21      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.1/10.1 MB 20.1 MB/s eta 0:00:00
88.12 Collecting protobuf
88.13   Downloading protobuf-5.29.2-cp38-abi3-manylinux2014_x86_64.whl (319 kB)
88.15      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 319.7/319.7 KB 17.5 MB/s eta 0:00:00
88.61 Collecting dill
88.63   Downloading dill-0.3.9-py3-none-any.whl (119 kB)
88.64      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 119.4/119.4 KB 13.8 MB/s eta 0:00:00
89.01 Collecting astor
89.02   Downloading astor-0.8.1-py2.py3-none-any.whl (27 kB)
89.12 Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from outlines==0.1.11->vllm==0.6.6.dev44+gc2d1b075.openvino) (3.1.4)
89.63 Collecting interegular
89.65   Downloading interegular-0.3.3-py37-none-any.whl (23 kB)
90.15 Collecting airportsdata
90.17   Downloading airportsdata-20241001-py3-none-any.whl (912 kB)
90.23      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 912.7/912.7 KB 20.4 MB/s eta 0:00:00
90.67 Collecting referencing
90.69   Downloading referencing-0.35.1-py3-none-any.whl (26 kB)
91.18 Collecting pycountry
91.19   Downloading pycountry-24.6.1-py3-none-any.whl (6.3 MB)
91.48      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.3/6.3 MB 22.1 MB/s eta 0:00:00
91.75 Collecting jsonschema
91.76   Downloading jsonschema-4.23.0-py3-none-any.whl (88 kB)
91.78      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.5/88.5 KB 9.5 MB/s eta 0:00:00
92.20 Collecting nest_asyncio
92.21   Downloading nest_asyncio-1.6.0-py3-none-any.whl (5.2 kB)
92.70 Collecting outlines_core==0.1.26
92.72   Downloading outlines_core-0.1.26-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (343 kB)
92.74      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 343.6/343.6 KB 17.8 MB/s eta 0:00:00
92.94 Collecting diskcache
92.96   Downloading diskcache-5.6.3-py3-none-any.whl (45 kB)
92.97      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.5/45.5 KB 6.1 MB/s eta 0:00:00
92.99 Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from torch==2.5.1->vllm==0.6.6.dev44+gc2d1b075.openvino) (2024.12.0)
92.99 Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch==2.5.1->vllm==0.6.6.dev44+gc2d1b075.openvino) (3.4.2)
92.99 Requirement already satisfied: sympy==1.13.1 in /usr/local/lib/python3.10/dist-packages (from torch==2.5.1->vllm==0.6.6.dev44+gc2d1b075.openvino) (1.13.1)
93.06 Requirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.10/dist-packages (from sympy==1.13.1->torch==2.5.1->vllm==0.6.6.dev44+gc2d1b075.openvino) (1.3.0)
93.34 Collecting starlette<0.42.0,>=0.40.0
93.35   Downloading starlette-0.41.3-py3-none-any.whl (73 kB)
93.36      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73.2/73.2 KB 8.9 MB/s eta 0:00:00
93.39 Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from lm-format-enforcer<0.11,>=0.10.9->vllm==0.6.6.dev44+gc2d1b075.openvino) (24.2)
93.47 Collecting pillow
93.49   Downloading pillow-10.4.0-cp310-cp310-manylinux_2_28_x86_64.whl (4.5 MB)
93.70      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 21.4 MB/s eta 0:00:00
93.82 Collecting tiktoken>=0.6.0
93.84   Downloading tiktoken-0.7.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
93.91      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 17.8 MB/s eta 0:00:00
94.65 Collecting opencv-python-headless<5.0.0,>=4.0.0
94.67   Downloading opencv_python_headless-4.10.0.84-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (49.9 MB)
96.97      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.9/49.9 MB 15.8 MB/s eta 0:00:00
97.72 Collecting jiter<1,>=0.4.0
97.74   Downloading jiter-0.8.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (345 kB)
97.76      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 345.0/345.0 KB 18.6 MB/s eta 0:00:00
98.13 Collecting distro<2,>=1.7.0
98.14   Downloading distro-1.9.0-py3-none-any.whl (20 kB)
98.55 Collecting httpx<1,>=0.23.0
98.56   Downloading httpx-0.28.1-py3-none-any.whl (73 kB)
98.57      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 73.5/73.5 KB 10.4 MB/s eta 0:00:00
98.73 Collecting sniffio
98.75   Downloading sniffio-1.3.1-py3-none-any.whl (10 kB)
99.27 Collecting anyio<5,>=3.5.0
99.28   Downloading anyio-4.7.0-py3-none-any.whl (93 kB)
99.29      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 93.1/93.1 KB 9.2 MB/s eta 0:00:00
99.87 Collecting openvino-telemetry>=2023.2.1
99.89   Downloading openvino_telemetry-2024.5.0-py3-none-any.whl (23 kB)
100.4 Collecting annotated-types>=0.6.0
100.4   Downloading annotated_types-0.7.0-py3-none-any.whl (13 kB)
102.5 Collecting pydantic-core==2.27.2
102.6   Downloading pydantic_core-2.27.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB)
102.7      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 18.9 MB/s eta 0:00:00
102.9 Collecting certifi>=2017.4.17
102.9   Downloading certifi-2024.12.14-py3-none-any.whl (164 kB)
103.0      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 164.9/164.9 KB 12.3 MB/s eta 0:00:00
103.6 Collecting charset-normalizer<4,>=2
103.6   Downloading charset_normalizer-3.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (144 kB)
103.6      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 144.8/144.8 KB 15.8 MB/s eta 0:00:00
104.0 Collecting urllib3<3,>=1.21.1
104.0   Downloading urllib3-2.3.0-py3-none-any.whl (128 kB)
104.1      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 128.4/128.4 KB 11.6 MB/s eta 0:00:00
104.3 Collecting idna<4,>=2.5
104.4   Downloading idna-3.10-py3-none-any.whl (70 kB)
104.4      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 70.4/70.4 KB 10.4 MB/s eta 0:00:00
105.7 Collecting regex>=2022.1.18
105.7   Downloading regex-2024.11.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (781 kB)
105.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 781.7/781.7 KB 19.3 MB/s eta 0:00:00
106.3 Collecting huggingface-hub<1.0,>=0.16.4
106.4   Downloading huggingface_hub-0.27.0-py3-none-any.whl (450 kB)
106.4      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 450.5/450.5 KB 18.4 MB/s eta 0:00:00
107.7 Collecting safetensors>=0.4.1
107.7   Downloading safetensors-0.4.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (435 kB)
107.7      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 435.0/435.0 KB 8.4 MB/s eta 0:00:00
108.3 Collecting pybind11
108.3   Downloading pybind11-2.13.6-py3-none-any.whl (243 kB)
108.3      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 243.3/243.3 KB 14.7 MB/s eta 0:00:00
108.8 Collecting pytest
108.8   Downloading pytest-8.3.4-py3-none-any.whl (343 kB)
108.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 343.1/343.1 KB 17.5 MB/s eta 0:00:00
109.3 Collecting attrs>=17.3.0
109.3   Downloading attrs-24.3.0-py3-none-any.whl (63 kB)
109.3      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.4/63.4 KB 7.3 MB/s eta 0:00:00
109.8 Collecting frozenlist>=1.1.1
109.8   Downloading frozenlist-1.5.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (241 kB)
109.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 241.9/241.9 KB 17.8 MB/s eta 0:00:00
110.2 Collecting async-timeout<6.0,>=4.0
110.2   Downloading async_timeout-5.0.1-py3-none-any.whl (6.2 kB)
110.7 Collecting propcache>=0.2.0
110.7   Downloading propcache-0.2.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (205 kB)
110.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 205.1/205.1 KB 11.8 MB/s eta 0:00:00
111.7 Collecting multidict<7.0,>=4.5
111.7   Downloading multidict-6.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (124 kB)
111.7      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 124.6/124.6 KB 15.5 MB/s eta 0:00:00
112.0 Collecting aiohappyeyeballs>=2.3.0
112.1   Downloading aiohappyeyeballs-2.4.4-py3-none-any.whl (14 kB)
112.5 Collecting aiosignal>=1.1.2
112.5   Downloading aiosignal-1.3.2-py2.py3-none-any.whl (7.6 kB)
113.7 Collecting yarl<2.0,>=1.17.0
113.7   Downloading yarl-1.18.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (319 kB)
113.7      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 319.7/319.7 KB 18.0 MB/s eta 0:00:00
114.2 Collecting zipp>=3.20
114.2   Downloading zipp-3.21.0-py3-none-any.whl (9.6 kB)
114.5 Collecting optimum@ git+https://github.com/huggingface/optimum.git
114.5   Cloning https://github.com/huggingface/optimum.git to /tmp/pip-install-blx0cev2/optimum_ae33e540bfd8422f9636869684578ab5
114.5   Running command git clone --filter=blob:none --quiet https://github.com/huggingface/optimum.git /tmp/pip-install-blx0cev2/optimum_ae33e540bfd8422f9636869684578ab5
116.2   Resolved https://github.com/huggingface/optimum.git to commit d21256c2964945fc3fe4623f7befb21082b69a25
116.4   Installing build dependencies: started
121.0   Installing build dependencies: finished with status 'done'
121.0   Getting requirements to build wheel: started
121.3   Getting requirements to build wheel: finished with status 'done'
121.3   Preparing metadata (pyproject.toml): started
121.6   Preparing metadata (pyproject.toml): finished with status 'done'
121.7 INFO: pip is looking at multiple versions of optimum to determine which version is compatible with other requirements. This could take a while.
121.7 INFO: pip is looking at multiple versions of msgspec to determine which version is compatible with other requirements. This could take a while.
121.7 Collecting msgspec
121.7   Downloading msgspec-0.18.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (203 kB)
121.7      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 203.9/203.9 KB 12.3 MB/s eta 0:00:00
121.7 INFO: pip is looking at multiple versions of importlib-metadata to determine which version is compatible with other requirements. This could take a while.
121.8 Collecting importlib-metadata
121.8   Downloading importlib_metadata-8.4.0-py3-none-any.whl (26 kB)
121.8 INFO: pip is looking at multiple versions of einops to determine which version is compatible with other requirements. This could take a while.
121.8 Collecting einops
121.8   Downloading einops-0.7.0-py3-none-any.whl (44 kB)
121.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.6/44.6 KB 8.5 MB/s eta 0:00:00
121.8 INFO: pip is looking at multiple versions of cloudpickle to determine which version is compatible with other requirements. This could take a while.
121.8 Collecting cloudpickle
121.9   Downloading cloudpickle-3.0.0-py3-none-any.whl (20 kB)
121.9 INFO: pip is looking at multiple versions of blake3 to determine which version is compatible with other requirements. This could take a while.
121.9 Collecting blake3
121.9   Downloading blake3-0.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
122.0      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 19.5 MB/s eta 0:00:00
122.0 INFO: pip is looking at multiple versions of aiohttp to determine which version is compatible with other requirements. This could take a while.
122.0 Collecting aiohttp
122.1   Downloading aiohttp-3.11.10-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
122.1      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 20.0 MB/s eta 0:00:00
122.2 INFO: pip is looking at multiple versions of xgrammar to determine which version is compatible with other requirements. This could take a while.
122.2 Collecting xgrammar>=0.1.6
122.2   Downloading xgrammar-0.1.6-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (331 kB)
122.2      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 331.4/331.4 KB 16.4 MB/s eta 0:00:00
122.3 INFO: pip is looking at multiple versions of optimum to determine which version is compatible with other requirements. This could take a while.
122.3 INFO: pip is looking at multiple versions of typing-extensions to determine which version is compatible with other requirements. This could take a while.
122.7 Collecting typing-extensions>=4.10
122.7   Using cached typing_extensions-4.12.2-py3-none-any.whl (37 kB)
122.7 INFO: pip is looking at multiple versions of transformers to determine which version is compatible with other requirements. This could take a while.
122.7 Collecting transformers>=4.45.2
122.8   Downloading transformers-4.47.0-py3-none-any.whl (10.1 MB)
123.2      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.1/10.1 MB 21.4 MB/s eta 0:00:00
123.3 INFO: pip is looking at multiple versions of tqdm to determine which version is compatible with other requirements. This could take a while.
123.3 Collecting tqdm
123.4   Downloading tqdm-4.67.0-py3-none-any.whl (78 kB)
123.4      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.6/78.6 KB 9.5 MB/s eta 0:00:00
123.4 INFO: pip is looking at multiple versions of tokenizers to determine which version is compatible with other requirements. This could take a while.
123.4 Collecting tokenizers>=0.19.1
123.4   Downloading tokenizers-0.20.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
123.6      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 18.6 MB/s eta 0:00:00
123.6 INFO: pip is looking at multiple versions of tiktoken to determine which version is compatible with other requirements. This could take a while.
123.6 INFO: pip is looking at multiple versions of requests to determine which version is compatible with other requirements. This could take a while.
123.7 Collecting requests>=2.26.0
123.7   Downloading requests-2.32.2-py3-none-any.whl (63 kB)
123.7      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.9/63.9 KB 9.9 MB/s eta 0:00:00
123.7 INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
123.7 INFO: pip is looking at multiple versions of pyyaml to determine which version is compatible with other requirements. This could take a while.
123.7 Collecting pyyaml
123.7   Downloading PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (705 kB)
123.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 705.5/705.5 KB 19.3 MB/s eta 0:00:00
123.8 INFO: pip is looking at multiple versions of pydantic-core to determine which version is compatible with other requirements. This could take a while.
123.8 INFO: pip is looking at multiple versions of pydantic to determine which version is compatible with other requirements. This could take a while.
123.8 Collecting pydantic>=2.9
123.8   Downloading pydantic-2.10.3-py3-none-any.whl (456 kB)
123.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 457.0/457.0 KB 18.7 MB/s eta 0:00:00
123.9 INFO: pip is looking at multiple versions of prometheus-fastapi-instrumentator to determine which version is compatible with other requirements. This could take a while.
123.9 INFO: pip is looking at multiple versions of prometheus-client to determine which version is compatible with other requirements. This could take a while.
123.9 Collecting prometheus-client>=0.18.0
123.9   Downloading prometheus_client-0.21.0-py3-none-any.whl (54 kB)
123.9      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.7/54.7 KB 9.6 MB/s eta 0:00:00
123.9 INFO: pip is looking at multiple versions of pillow to determine which version is compatible with other requirements. This could take a while.
123.9 Collecting pillow
123.9   Downloading pillow-10.3.0-cp310-cp310-manylinux_2_28_x86_64.whl (4.5 MB)
124.1      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 22.2 MB/s eta 0:00:00
124.2 INFO: pip is looking at multiple versions of openvino to determine which version is compatible with other requirements. This could take a while.
124.2 Collecting openvino>=2024.4.0
124.2   Downloading openvino-2024.5.0-17288-cp310-cp310-manylinux2014_x86_64.whl (44.6 MB)
126.3      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.6/44.6 MB 16.3 MB/s eta 0:00:00
126.4 INFO: pip is looking at multiple versions of openai to determine which version is compatible with other requirements. This could take a while.
126.5 Collecting openai>=1.52.0
126.5   Downloading openai-1.58.0-py3-none-any.whl (454 kB)
126.5      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 454.3/454.3 KB 17.9 MB/s eta 0:00:00
126.5 INFO: pip is looking at multiple versions of numpy to determine which version is compatible with other requirements. This could take a while.
126.5 Collecting numpy<2.0.0
126.5   Downloading https://download.pytorch.org/whl/numpy-1.26.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB)
127.5      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18.2/18.2 MB 20.4 MB/s eta 0:00:00
127.5 INFO: pip is looking at multiple versions of sentencepiece to determine which version is compatible with other requirements. This could take a while.
127.5 INFO: pip is looking at multiple versions of mistral-common[opencv] to determine which version is compatible with other requirements. This could take a while.
127.5 Collecting mistral-common[opencv]>=1.5.0
127.6   Downloading mistral_common-1.5.0-py3-none-any.whl (6.2 MB)
127.9      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.2/6.2 MB 21.2 MB/s eta 0:00:00
127.9 INFO: pip is looking at multiple versions of lm-format-enforcer to determine which version is compatible with other requirements. This could take a while.
127.9 INFO: pip is looking at multiple versions of filelock to determine which version is compatible with other requirements. This could take a while.
128.4 Collecting filelock>=3.16.1
128.4   Using cached filelock-3.16.1-py3-none-any.whl (16 kB)
128.4 INFO: pip is looking at multiple versions of fastapi to determine which version is compatible with other requirements. This could take a while.
128.4 Collecting fastapi!=0.113.*,!=0.114.0,>=0.107.0
128.4   Downloading fastapi-0.115.5-py3-none-any.whl (94 kB)
128.4      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94.9/94.9 KB 9.2 MB/s eta 0:00:00
128.4 INFO: pip is looking at multiple versions of sympy to determine which version is compatible with other requirements. This could take a while.
128.9 Collecting sympy==1.13.1
128.9   Using cached https://download.pytorch.org/whl/sympy-1.13.1-py3-none-any.whl (6.2 MB)
129.0 INFO: pip is looking at multiple versions of outlines-core to determine which version is compatible with other requirements. This could take a while.
129.0 INFO: pip is looking at multiple versions of torch to determine which version is compatible with other requirements. This could take a while.
129.7 Collecting torch==2.5.1
132.0   Using cached https://download.pytorch.org/whl/cpu/torch-2.5.1%2Bcpu-cp310-cp310-linux_x86_64.whl (174.7 MB)
133.1   Downloading torch-2.5.1-cp310-cp310-manylinux1_x86_64.whl (906.4 MB)
175.7      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 906.4/906.4 MB 2.0 MB/s eta 0:00:00
179.1 Collecting triton==3.1.0
179.2   Downloading https://download.pytorch.org/whl/triton-3.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (209.5 MB)
188.7      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 209.5/209.5 MB 7.7 MB/s eta 0:00:00
189.9 Collecting nvidia-cudnn-cu12==9.1.0.70
189.9   Downloading nvidia_cudnn_cu12-9.1.0.70-py3-none-manylinux2014_x86_64.whl (664.8 MB)
220.4      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 664.8/664.8 MB 3.1 MB/s eta 0:00:00
223.1 Collecting nvidia-nccl-cu12==2.21.5
223.1   Downloading https://download.pytorch.org/whl/nvidia_nccl_cu12-2.21.5-py3-none-manylinux2014_x86_64.whl (188.7 MB)
231.7      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 188.7/188.7 MB 7.6 MB/s eta 0:00:00
232.9 Collecting nvidia-cuda-cupti-cu12==12.4.127
232.9   Downloading nvidia_cuda_cupti_cu12-12.4.127-py3-none-manylinux2014_x86_64.whl (13.8 MB)
233.5      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.8/13.8 MB 20.9 MB/s eta 0:00:00
234.0 Collecting nvidia-cuda-nvrtc-cu12==12.4.127
234.1   Downloading nvidia_cuda_nvrtc_cu12-12.4.127-py3-none-manylinux2014_x86_64.whl (24.6 MB)
235.2      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24.6/24.6 MB 19.8 MB/s eta 0:00:00
235.8 Collecting nvidia-nvtx-cu12==12.4.127
235.8   Downloading nvidia_nvtx_cu12-12.4.127-py3-none-manylinux2014_x86_64.whl (99 kB)
235.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 99.1/99.1 KB 8.9 MB/s eta 0:00:00
236.3 Collecting nvidia-nvjitlink-cu12==12.4.127
236.3   Downloading nvidia_nvjitlink_cu12-12.4.127-py3-none-manylinux2014_x86_64.whl (21.1 MB)
237.3      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 21.1/21.1 MB 19.8 MB/s eta 0:00:00
237.9 Collecting nvidia-cuda-runtime-cu12==12.4.127
237.9   Downloading nvidia_cuda_runtime_cu12-12.4.127-py3-none-manylinux2014_x86_64.whl (883 kB)
238.0      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 883.7/883.7 KB 14.8 MB/s eta 0:00:00
238.5 Collecting nvidia-cusparse-cu12==12.3.1.170
238.5   Downloading nvidia_cusparse_cu12-12.3.1.170-py3-none-manylinux2014_x86_64.whl (207.5 MB)
248.0      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 207.5/207.5 MB 8.1 MB/s eta 0:00:00
249.2 Collecting nvidia-cufft-cu12==11.2.1.3
249.2   Downloading nvidia_cufft_cu12-11.2.1.3-py3-none-manylinux2014_x86_64.whl (211.5 MB)
260.5      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 211.5/211.5 MB 7.7 MB/s eta 0:00:00
261.7 Collecting nvidia-curand-cu12==10.3.5.147
261.7   Downloading nvidia_curand_cu12-10.3.5.147-py3-none-manylinux2014_x86_64.whl (56.3 MB)
264.3      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.3/56.3 MB 15.1 MB/s eta 0:00:00
264.9 Collecting nvidia-cublas-cu12==12.4.5.8
265.0   Downloading nvidia_cublas_cu12-12.4.5.8-py3-none-manylinux2014_x86_64.whl (363.4 MB)
281.9      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 363.4/363.4 MB 4.6 MB/s eta 0:00:00
283.6 Collecting nvidia-cusolver-cu12==11.6.1.9
283.6   Downloading nvidia_cusolver_cu12-11.6.1.9-py3-none-manylinux2014_x86_64.whl (127.9 MB)
289.5      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 127.9/127.9 MB 10.7 MB/s eta 0:00:00
290.0 INFO: pip is looking at multiple versions of triton to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-nvtx-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-nvjitlink-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-nccl-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-cusparse-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-cusolver-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-curand-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-cufft-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-cudnn-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-cuda-runtime-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-cuda-nvrtc-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-cuda-cupti-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of nvidia-cublas-cu12 to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of outlines to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of lark to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of gguf to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of depyf to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of compressed-tensors to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of <Python from Requires-Python> to determine which version is compatible with other requirements. This could take a while.
290.0 INFO: pip is looking at multiple versions of vllm to determine which version is compatible with other requirements. This could take a while.
290.0 ERROR: Cannot install optimum-intel[nncf]==1.22.0.dev0+ea6fa42 and vllm==0.6.6.dev44+gc2d1b075.openvino because these package versions have conflicting dependencies.
290.0 
290.0 The conflict is caused by:
290.0     vllm 0.6.6.dev44+gc2d1b075.openvino depends on optimum 1.24.0.dev0 (from git+https://github.com/huggingface/optimum.git@main)
290.0     optimum-intel[nncf] 1.22.0.dev0+ea6fa42 depends on optimum 1.24.0.dev0 (from git+https://github.com/huggingface/optimum.git)
290.0 
290.0 To fix this you could try to:
290.0 1. loosen the range of package versions you've specified
290.0 2. remove package versions to allow pip attempt to solve the dependency conflict
290.0 
290.0 ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
------
Dockerfile.openvino:20
--------------------
  18 |     RUN PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu" python3 -m pip install -r /workspace/requirements-build.txt
  19 |     # build vLLM with OpenVINO backend
  20 | >>> RUN PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu" VLLM_TARGET_DEVICE="openvino" python3 -m pip install /workspace
  21 |     
  22 |     COPY examples/ /workspace/examples
--------------------
ERROR: failed to solve: process "/bin/sh -c PIP_EXTRA_INDEX_URL=\"https://download.pytorch.org/whl/cpu\" VLLM_TARGET_DEVICE=\"openvino\" python3 -m pip install /workspace" did not complete successfully: exit code: 1

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[7SKWL5]

Same error message during installation via :

• Install from source :

How you are installing vllm

- PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cpu" VLLM_TARGET_DEVICE=openvino python3.12 -m pip install -v .
INFO: pip is looking at multiple versions of optimum-intel to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install optimum-intel and vllm==0.6.6.dev44+gc2d1b075.openvino because these package versions have conflicting dependencies.

The conflict is caused by:
    vllm 0.6.6.dev44+gc2d1b075.openvino depends on optimum 1.24.0.dev0 (from git+https://github.com/huggingface/optimum.git@main)
    optimum-intel 1.22.0.dev0+ea6fa42 depends on optimum 1.24.0.dev0 (from git+https://github.com/huggingface/optimum.git)

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip to attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts"

[DarkLight1337]

See also #11398

[ilya-lavrenov]

Fixed in #11458

[7SKWL5]

Thanks for the fix.