[Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step#6338
Merged
comaniac merged 32 commits intovllm-project:mainfrom neuralmagic:prepare_inputs_on_gpuJul 17, 2024
+568-130
Commits
Commits on Jul 17, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed