Skip to content

Add Float8 Weight Only and FP8 weight + dynamic activation #3090

Add Float8 Weight Only and FP8 weight + dynamic activation

Add Float8 Weight Only and FP8 weight + dynamic activation #3090

Annotations

1 warning

test (CUDA 2.4, linux.g5.12xlarge.nvidia.gpu, torch==2.4.0, cuda, 12.1)  /  linux-job

succeeded Aug 30, 2024 in 29m 8s