Skip to content

[Feature][kernel] tensor parallelism with bitsandbytes quantization#8434

Merged
simon-mo merged 5 commits intovllm-project:mainfrom bd-iaas-us:qian/bnb-tpSep 17, 2024

Commits

Commits on Sep 13, 2024

Commits on Sep 16, 2024