Why is this not working for the current release. UNABLE TO USE GPU

[AnirudhJM24]

          I got it to works just like instruction, I'm using CUDA 12.3:

set CMAKE_ARGS="-DLLAMA_CUBLAS=on" && set FORCE_CMAKE=1 && pip install --no-cache-dir llama-cpp-python==0.2.90 --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu123

Originally posted by @BinhPQ2 in #576 (comment)

[BinhPQ2]

What is your CUDA version?

And you can try to update your Visual Studio Built Tool to see if it will solve the problem!
https://visualstudio.microsoft.com/downloads/?q=build+tools