Skip to content

Add Float8 Weight Only and FP8 weight + dynamic activation #3090

Add Float8 Weight Only and FP8 weight + dynamic activation

Add Float8 Weight Only and FP8 weight + dynamic activation #3090

Annotations

1 warning

test (CUDA 2.2.2, linux.g5.12xlarge.nvidia.gpu, torch==2.2.2 "numpy<2" , cuda, 12.1)  /  linux-job

succeeded Aug 30, 2024 in 15m 23s