Skip to content

[Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step#6338

Merged
comaniac merged 32 commits intovllm-project:mainfrom neuralmagic:prepare_inputs_on_gpuJul 17, 2024

Commits

Commits on Jul 17, 2024