Code

Code structure refactor#807

Code

Merged

hnyls2002 merged 9 commits intomainsgl-project/sglang:mainfrom refactorsgl-project/sglang:refactorCopy head branch name to clipboardJul 30, 2024

+105-104

Commits

Commits on Jul 29, 2024

• rename

  hnyls2002

  committed
  6707588

• move model_runner, cudagraph_runner into model_executor

  hnyls2002

  committed
  3637ad4

• make mem_cache module

  hnyls2002

  committed
  38c2915

• remove srt.managers.controller

  hnyls2002

  committed
  e45e4b3

• move flush_cache

  hnyls2002

  committed
  a9d3306

• rename: infer_batch -> schedule_batch

  hnyls2002

  committed
  6a1b06a

• rename

  hnyls2002

  committed
  3857670

Commits on Jul 30, 2024

• Merge branch 'main' into refactor

  hnyls2002

  committed
  f838189

• organize APIs

  hnyls2002

  committed
  afd3427