CUDNN_STATUS_NOT_SUPPORTED

[jenspr]

Hey there, I am pretty new to AI/models/transformer.

Tried to follow the installation instruction on hugging face colab

• Pytorch CUDA 12.8 (reports Cudnn 8881)
• However, latest Nvidia CUDA Toolkit installed 12,8 which says in there compatibility matrix that is on ly compatible eith a cuDnn version of 9.x
• Which is why I installed the cuDnn version from their webside. Still Pytorch reports the above version number. I did suspect a version conflict is part of my problem.
• Reinstalled pytorch, still reporting the abovce cuDnn version
• Read, pytorch comes with their own cuDnn and CUDA and is not using the ones I installed locally (from Nvidia)

.. now wondering what to do next. I have no clue. Am I really fighting a version conflict. Which software should I replace. Or does my error come from something completely different? Hope you can help a beginner here.. or at least point into the right direction.

[JonathanFly]

I would look for a guide that uses venv or conda to setup from a scratch. If you are windows, maybe a WSL guide is best. Or look at a guide for setting up Huggingface Transformers.

You have to have exact version matches between all those libraries which is why people use conda and equivalent tools, it's a headache!