cuda on windows not working #17812
alosslessdev started this conversation in General
Replies: 4 comments 6 replies
-
solved by using the winget version but it uses vulkan |
BetaWas this translation helpful?Give feedback.
1 reply
-
Did you also download |
BetaWas this translation helpful?Give feedback.
1 reply
-
@alosslessdev What GPU are you using? If you're on a Blackwell GPU, the prebuilt Windows releases won't work because they are built against CUDA 12.4, while 12.8+ is required for Blackwell. |
BetaWas this translation helpful?Give feedback.
1 reply
-
Would a CUDA 13 release help? #17839 |
BetaWas this translation helpful?Give feedback.
3 replies
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I downloaded the latest prebuilt cuda version from the releases page, and when i try to run it on windows, it doesn't seem to recognize the gpu even though i have the nvidia driver installed. I even tried downloading the latest cuda toolkit but nothing. How can i make cuda work with llama.cpp? I don't mind using the linux version...
BetaWas this translation helpful?Give feedback.
All reactions