Code

[WIP] Use FlashInfer RoPE#2016

Code

Open

james-p-xu wants to merge 2 commits intosgl-project:mainsgl-project/sglang:mainfrom james-p-xu:rope_comparisonjames-p-xu/sglang:rope_comparisonCopy head branch name to clipboard

+416-1

Commits

Commits on Dec 10, 2024

• Add RoPE comparison across flashinfer and vLLM

  james-p-xu

  committed
  a84ee5a

• feat: use FlashInfer RoPE (llama)

  james-p-xu

  committed
  0d70c43