Add torchao quant (int4/int8/fp8) to llama models#1341
Merged
merrymercy merged 8 commits intosgl-project:mainfrom jerryzh168:enable-torchaoSep 9, 2024
+151-12
Commits
Commits on Sep 6, 2024
Commits on Sep 7, 2024
- committed
- committed
Commits on Sep 9, 2024
- authored
- committed
- committed
- committed
- committed
