Skip to content

Add Float8 Weight Only and FP8 weight + dynamic activation #3090

Add Float8 Weight Only and FP8 weight + dynamic activation

Add Float8 Weight Only and FP8 weight + dynamic activation #3090

Annotations

1 warning

test (CUDA Nightly, linux.g5.12xlarge.nvidia.gpu, --pre torch --index-url https://download.pytorc...  /  linux-job

succeeded Aug 30, 2024 in 44m 34s