[Benchmark] Add --async-engine option to benchmark_throughput.py#7964
Merged
robertgshaw2-neuralmagic merged 2 commits intovllm-project:mainfrom njhill:async-llm-eng-benchSep 4, 2024
+143-19
--async-engine option to benchmark_throughput.py#7964