Skip to content

[BugFix] lazy init _copy_stream to avoid torch init wrong gpu instance#8403

Merged
simon-mo merged 2 commits intovllm-project:mainfrom lnykww:mainSep 12, 2024

Commits

Commits on Sep 12, 2024