New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add bitsandbytes to requirements and use fixed vllm version in the client #27

Merged

ilya-lavrenov merged 2 commits into ilya-lavrenov:openvino-model-executor from mzegla:missing_req

Apr 10, 2024

mzegla commented Apr 4, 2024

bitsandbytes package is required by baichuan model
there were errors when running benchmark sample with latest vllm, using fixed version gives more stability

mzegla added 2 commits

April 10, 2024 10:37


          add bitsandbytes to requirements, use fixed vllm version in the client

601115c


          relax openvino requirement to support latest master

2547b12

mzegla force-pushed the missing_req branch from 4569577 to 2547b12 Compare

April 10, 2024 09:17

ilya-lavrenov approved these changes

View reviewed changes

ilya-lavrenov merged commit 948137a into ilya-lavrenov:openvino-model-executor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet