Skip to content
Back to pull request #5656

[Model] Add FP8 kv cache for Qwen2 #12113

Sign in to view logs

[Model] Add FP8 kv cache for Qwen2

[Model] Add FP8 kv cache for Qwen2 #12113

Run time

Learn about OS pricing on GitHub Actions
Job Run time
yapf (3.8)
1m 9s
yapf (3.9)
1m 11s
yapf (3.10)
1m 8s
yapf (3.11)
44s
4m 12s