-
Notifications
You must be signed in to change notification settings - Fork 951
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Pre-built cpu wheel does not work on Ubuntu due to libc.musl dependency #1628
Comments
Yeah, for some reason the wheels are being build with musl instead of glibc. My fix was to do this: apt install musl-dev
ln -s /usr/lib/x86_64-linux-musl/libc.so /lib/libc.musl-x86_64.so.1 |
@gaby yes, I did the same and it works fine. But I would consider that to be more of a work around rather than a long-term solution. |
I would definitely consider this a workaround. I am using this lib to reduce a docker image size, so I don't want to install Probably related: #1507 |
It looks like the issue has been fixed in the latest version (0.2.88). Thanks! |
Note that the prebuilt wheel is not there for 0.2.88... |
@arpesenti I don't think it was fixed.
|
Prerequisites
Please answer the following questions for yourself before submitting an issue.
Expected Behavior
The pre-built cpu wheels should work out of the box on Ubuntu
Current Behavior
The pre-built cpu wheels depend on libc.musl, which is generally not available on most of the popular linux distributions.
Attempting to import llama_cpp results in the following error:
At the same time, the cuda wheel does not depend on musl and works out of the box on the same system.
Environment and Context
Ubuntu 22.04 / Ubuntu 24.04
Llama-cpp-python 0.2.82 / 0.2.83
Steps to Reproduce
Please provide detailed steps for reproducing the issue. We are not sitting in front of your screen, so the more detail the better.
Failure Logs
The text was updated successfully, but these errors were encountered: