[Bugfix] Flash attention arches not getting set properly#9062

Merged

mgoin merged 1 commit intovllm-project:mainfrom neuralmagic:lwilkinson/fix-flash-attention-arches

Oct 4, 2024

+11

Commits on Oct 4, 2024

set VLLM_GPU_ARCHES before flash attention in the cuda case
LucasWilkinson
committed