Skip to content
This repository has been archived by the owner on Oct 25, 2024. It is now read-only.
Chat Bot Test

[vLLM] QBits Perf Enhence #4969

Sign in to view logs

[vLLM] QBits Perf Enhence

[vLLM] QBits Perf Enhence #4969

Run time

Learn about OS pricing on GitHub Actions
Job Run time
call-inference-llama-2-7b-chat-hf / inference test
2m 19s
call-inference-mpt-7b-chat / inference test
2m 11s
4m 30s