[Misc] Add quantization config support for speculative model.#7343
Merged
youkaichao merged 18 commits intovllm-project:mainfrom ShangmingCai:add_speculative_model_quantizationAug 16, 2024
+71-4
Commits
Commits on Aug 9, 2024
Commits on Aug 12, 2024
Commits on Aug 13, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed