Code

Add engine api#1894

Code

Merged

merrymercy merged 6 commits intomainsgl-project/sglang:mainfrom add_engine_apisgl-project/sglang:add_engine_apiCopy head branch name to clipboardNov 3, 2024

+218-13

Commits

Commits on Nov 3, 2024

• add offline batch inference

  

  Chayenne

  committed
  6e6672e

• Merge branch 'main' into add_engine_api

  

  Chayenne

  committed
  1979b78

• delete sanic

  

  Chayenne

  committed
  3bf2946

• Add streaming and asyn

  

  Chayenne

  committed
  4ff1e87

• Add Streaming Asynchronous Generation

  

  Chayenne

  committed
  b86d1e9

• Update index.rst

  merrymercy

  authored
  3999943