Repositories list

• sglang

  Public
  SGLang is a fast serving framework for large language models and vision language models.

  cudainferencepytorch+ 10transformermoellamavlmllmllm-servingllava+ 3

  Python

  •

  Apache License 2.0

  •587•6.6k•122•31•Updated Dec 21, 2024Dec 21, 2024

• sgl-learning-materials

  Public
  Materials for learning SGLang

  MIT License

  •9•141•0•0•Updated Dec 21, 2024Dec 21, 2024

• sgl-project.github.io

  Public
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.

  HTML

  •1•0•0•0•Updated Dec 21, 2024Dec 21, 2024

• cutlass

  Public
  CUDA Templates for Linear Algebra Subroutines

  C++

  •

  Other

  •1k•0•0•0•Updated Dec 12, 2024Dec 12, 2024

• tensorrt-demo

  Public
  TensorRT LLM Benchmark Configuration

  Python

  •4•11•0•0•Updated Jul 26, 2024Jul 26, 2024