This repository has been archived by the owner on Oct 25, 2024. It is now read-only.
[vLLM] QBits Perf Enhence #4969
Zhenzhong1chatbot-test.yml
on: pull_request
call-inference-llama-2-7b-chat-hf
/
inference test
2m 19s
call-inference-mpt-7b-chat
/
inference test
2m 11s