Skip to content

[Bugfix] Fix incorrect vocal embedding shards for GGUF model in tensor parallelism #20556

[Bugfix] Fix incorrect vocal embedding shards for GGUF model in tensor parallelism

[Bugfix] Fix incorrect vocal embedding shards for GGUF model in tensor parallelism #20556

Annotations

2 warnings

This job succeeded