josStorer / RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
https://www.rwkv.com
MIT License
5.32k stars 504 forks source link

CUDA和Pytorch已经安装,但依然提示Failed CUDA #311

Open kgolin opened 8 months ago

kgolin commented 8 months ago

111121 CUDA和Pytorch已经安装,但依然提示Failed to switch model - Failed to enable custom CUDA kernel, ninja is required to load C++ extensions. You may be using the CPU version of PyTorch, please reinstall PyTorch with CUDA. Or if you are using a custom Python interpreter, you must compile the CUDA kernel by yourself or disable Custom CUDA kernel acceleration" 无标题1112

kgolin commented 8 months ago

将py310->Lib->site-packages下的torch和torch-1.13.1.dist-info文件夹删除,然后重开软件运行再根据提示装一边torch就解决了,不过我这里自动安装是cu117,还低了一版