-
Notifications
You must be signed in to change notification settings - Fork 533
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mosaicml-turbo: Where to find the repo? #565
Comments
The repo is currently private since we're not sure where our custom kernels should live yet. What environment are you running in (OS, presence of CUDA gpus, python version, etc)? The wheel exists on pypi, so it's a question of whether your setup supports it. |
Thanks for your response. I have finally managed to install it from the wheel after a few changes in my setup to match the requirements :-) |
awesome! Any insights on what needed to change? Would love to make this seamless for everyone else in the future. |
Hello, I ran into a similar problem, I am wondering what changes you made to install this package. Thanks |
In our supercomputing center we use python 3.11 and 3.12. Currently with around 5000 A100 GPUs using CUDA 12, with some 15000 more to come - probably with cuda 13, as they'll be GH200. So the cp310 wheel won't work for us. Would it be possible to have the source back on your repo as you had before? Thanks |
What's the future direction regarding mosaicml-turbo and llm-foundry? I get a bad feeling about investing in this code base if parts of it (in this case dependencies) are not open source. I know at the moment, mosaicml-turbo is only used for the Lion optimizer, but this could change in the future. |
Hi @janEbert and company - Oops - you caught us! We've been working on a package of kernels called Jonathan Frankle |
Thank you Jonathan for the timely response! I'll be sure to keep quiet as well. ;) Have you decided whether |
I'm trying to implement DecoupledLionW_8bit in my fine-tuning script, but I get the following error:
I haven't been able to find this repo anywhere. Can you please, help me?
The text was updated successfully, but these errors were encountered: