Code

Support mllama for pytorch engine#2605

Code

Merged

lvhan028 merged 17 commits intoInternLM:mainInternLM/lmdeploy:mainfrom AllentDan:mllamaAllentDan/lmdeploy:mllamaCopy head branch name to clipboardOct 24, 2024

+1,367-44

Commits

Commits on Oct 11, 2024

• support cross-cache

  grimoire

  committed
  aedd65b

Commits on Oct 15, 2024

• Support mllama in pytorch engine

  AllentDan

  committed
  2be0cbb

Commits on Oct 16, 2024

• add rewrite to support accelerate pp

  AllentDan

  committed
  cc71897

• update cross kv lens accordingly

  AllentDan

  committed
  5b9c354

• Merge branch 'main' into mllama

  Show description for f021d23
  AllentDan

  committed
  f021d23

• fix ut and fill cache index

  AllentDan

  committed
  f2a751a

Commits on Oct 18, 2024

• remove mllama.py

  AllentDan

  committed
  1f3dfd9

• fix pure text input error

  AllentDan

  committed
  7a2f310

• another cat for tp

  AllentDan

  committed
  4cb10a8

• fix

  AllentDan

  committed
  069aa46

Commits on Oct 21, 2024

• add no split module for 90B

  AllentDan

  committed
  f570a4a

• refine

  AllentDan

  committed
  ce06c6b

• update supported_models

  AllentDan

  committed
  1406981

Commits on Oct 22, 2024

• strict check

  AllentDan

  committed
  d1f38a2

• update image inputs

  AllentDan

  committed
  3c8b97c

• handle image with shape 1x1

  AllentDan

  committed
  4dbd419

Commits on Oct 23, 2024

• use config device

  AllentDan

  committed
  6875122