Code

[DRAFT] Compatibility Matrix#140

Code

Closed

wallashss wants to merge 19 commits intoopendatahub-io:mainopendatahub-io/vllm:mainfrom wallashss:compat_matrixwallashss/vllm:compat_matrixCopy head branch name to clipboard

+3,423-915

Commits

Commits on Sep 13, 2024

• [CI/Build] Enable InternVL2 PP test only on single node (vllm-project#8437)

  Isotr0py

  authored
  9b4a3b2

  Copy full SHA for 9b4a3b2

• [doc] recommend pip instead of conda (vllm-project#8446)

  youkaichao

  authored
  cab69a1

  Copy full SHA for cab69a1

• [Misc] Skip loading extra bias for Qwen2-VL GPTQ-Int8 (vllm-project#8442)

  jeejeelee

  authored
  06311e2

  Copy full SHA for 06311e2

• [misc][ci] fix quant test (vllm-project#8449)

  youkaichao

  authored
  a246912

  Copy full SHA for a246912

• [Installation] Gate FastAPI version for Python 3.8 (vllm-project#8456)

  DarkLight1337

  authored
  ecd7a1d

  Copy full SHA for ecd7a1d

• [plugin][torch.compile] allow to add custom compile backend (vllm-project#8445)

  youkaichao

  authored
  0a4806f

  Copy full SHA for 0a4806f

• [CI/Build] Reorganize models tests (vllm-project#7820)

  DarkLight1337

  authored
  a84e598

  Copy full SHA for a84e598

• [Doc] Add oneDNN installation to CPU backend documentation (vllm-project#8467)

  Isotr0py

  authored
  f57092c

  Copy full SHA for f57092c

• [HotFix] Fix final output truncation with stop string + streaming (vllm-project#8468)

  njhill

  authored
  18e9e1f

  Copy full SHA for 18e9e1f

• bump version to v0.6.1.post2 (vllm-project#8473)

  simon-mo

  authored
  9ba0817

  Copy full SHA for 9ba0817

• [Hardware][intel GPU] bump up ipex version to 2.3 (vllm-project#8365)

  Show description for 8517252
  

  jikunshang

  and

  yma11

  authored
  8517252

  Copy full SHA for 8517252

Commits on Sep 14, 2024

• [Kernel][Hardware][Amd]Custom paged attention kernel for rocm (vllm-project#8310)

  charlifu

  authored
  1ef0d2e

  Copy full SHA for 1ef0d2e

• [Model] support minicpm3 (vllm-project#8297)

  Show description for 8a0cf1d
  

  SUDA-HLT-ywfang

  and

  DarkLight1337

  authored
  8a0cf1d

  Copy full SHA for 8a0cf1d

• [torch.compile] fix functionalization (vllm-project#8480)

  youkaichao

  authored
  a36e070

  Copy full SHA for a36e070

• [torch.compile] add a flag to disable custom op (vllm-project#8488)

  youkaichao

  authored
  47790f3

  Copy full SHA for 47790f3

• [TPU] Implement multi-step scheduling (vllm-project#8489)

  WoosukKwon

  authored
  50e9ec4

  Copy full SHA for 50e9ec4

Commits on Sep 15, 2024

• [Bugfix][Model] Fix Python 3.8 compatibility in Pixtral model by updating type annotations (vllm-project#8490)

  chrisociepa

  authored
  3724d5f

  Copy full SHA for 3724d5f

• [Bugfix][Kernel] Add IQ1_M quantization implementation to GGUF kernel (vllm-project#8357)

  Isotr0py

  authored
  fc990f9

  Copy full SHA for fc990f9

Commits on Sep 16, 2024

• [Doc] Compatibility matrix for mutual exclusive features

  Show description for e72169b
  wallashss

  committed
  e72169b

  Copy full SHA for e72169b