Code

Whisper support#5964

Code

Closed

huseinzol05 wants to merge 16 commits intovllm-project:mainvllm-project/vllm:mainfrom mesolitica:mainmesolitica/vllm-whisper:mainCopy head branch name to clipboard

+1,968-28

Commits

Commits on Jun 27, 2024

• initial

  huseinzol05

  committed
  2d3347f

  Copy full SHA for 2d3347f

• added whisper encoder decoder

  huseinzol05

  committed
  860b70a

  Copy full SHA for 860b70a

• added configs

  huseinzol05

  committed
  c15bafc

  Copy full SHA for c15bafc

Commits on Jun 28, 2024

• able to load

  huseinzol05

  committed
  2c82ba7

  Copy full SHA for 2c82ba7

• able to forward

  huseinzol05

  committed
  d46c5c8

  Copy full SHA for d46c5c8

• added example

  huseinzol05

  committed
  6051782

  Copy full SHA for 6051782

• fix load weights

  huseinzol05

  committed
  3a8258f

  Copy full SHA for 3a8258f

Commits on Jun 29, 2024

• fix whisper

  huseinzol05

  committed
  8a837c0

  Copy full SHA for 8a837c0

• added predict lang in whisper example

  huseinzol05

  committed
  2d62f45

  Copy full SHA for 2d62f45

Commits on Jun 30, 2024

• added cudagraph, whisper no longer as multimodal

  huseinzol05

  committed
  1eb13dd

  Copy full SHA for 1eb13dd

• able to decode properly

  huseinzol05

  committed
  3db307f

  Copy full SHA for 3db307f

Commits on Jul 1, 2024

• initial whisper serving

  huseinzol05

  committed
  00ed7ea

  Copy full SHA for 00ed7ea

Commits on Jul 2, 2024

• improve whisper serving

  huseinzol05

  committed
  5b16982

  Copy full SHA for 5b16982

• added streaming token

  huseinzol05

  committed
  7828dc9

  Copy full SHA for 7828dc9

• added non streaming

  huseinzol05

  committed
  fa81def

  Copy full SHA for fa81def

Commits on Jul 28, 2024

• fix whisper example

  huseinzol05

  committed
  ebf1cbf

  Copy full SHA for ebf1cbf