WIP
A tiny flash attention implement in python, rust, cuda and c for learning purpose.
- python version
- triton version
- [c version]
- [rust version]
my env: cutlass v3.4, torch 1.14, cuda 12.4
-
Notifications
You must be signed in to change notification settings - Fork 15
66RING/tiny-flash-attention
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
flash attention tutorial written in python, triton, cuda, cutlass
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published