Ipanfilo/fa support#96

Open

ipanfilo wants to merge 13 commits intodevfrom ipanfilo/fa_support

+90-79

Commits on Nov 28, 2024

Fix an argument issue when flash_attn>=2.5.7 (#1068)

authored and
ipanfilo
committed
[PyTorch] Fix issues with cross attention (#1069)

authored and
ipanfilo
committed

Commits on Nov 29, 2024

Hide non-necessary symbols from shared object (#1136)

ksivaman
authored and
ipanfilo
committed

Commits on Dec 3, 2024

Commits on Dec 10, 2024

Enable FA 2.6.0+ and THD related code
ipanfilo
committed

Commits on Dec 19, 2024

Support FA2.6+ softmax_lse format for BSHD/SBHD
ipanfilo
committed

Commits on Dec 23, 2024

Merge dev changes; Disable parallel pytest, disable unsupported FA tests
ipanfilo
committed

Commits on Jan 4, 2025

Commits on Jan 7, 2025

Fix skip conditions and update readme
ipanfilo
committed

Commits on Jan 23, 2025