search

josStorer / RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
https://www.rwkv.com
MIT License
5.31k stars 502 forks source link

Failed to enable custom CUDA kernel #310

Open Firepal opened 8 months ago

Firepal commented 8 months ago

after running "install-py-dep.bat" and trying to run GPU-4G-3B-World

"Failed to switch model - Failed to enable custom CUDA kernel, ninja is required to load C++ extensions. You may be using the CPU version of PyTorch, please reinstall PyTorch with CUDA. Or if you are using a custom Python interpreter, you must compile the CUDA kernel by yourself or disable Custom CUDA kernel acceleration"

kgolin commented 8 months ago

you need to confirm that CUDA and pytorch are installed on your computer

Firepal commented 8 months ago

@kgolin ??? the script does get cu117, and i have cuda toolkit

josStorer commented 8 months ago

Are you using Python 3.10? The precompiled kernel in the software is only available in Python 3.10.