Skip to content

[Bugfix] Enable chunked-prefill and prefix cache with flash-attn backend#6144

Closed
sighingnow wants to merge 2 commits intovllm-project:mainfrom sighingnow:ht/fixes-chunked-cached
+168-17

Commits

Commits on Aug 21, 2024