search

BlinkDL / RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
Apache License 2.0
12.05k stars 827 forks source link

transformers代码加载cuda失败 #159

Closed wpwpwpyo closed 11 months ago

wpwpwpyo commented 1 year ago

您好，我下载了4.30.2版本的transformers，model = RwkvModel.from_pretrained("RWKV/rwkv-4-169m-pile")载入rwkv模型时，modeling_rwkv.py文件中的load_wkv_cuda_kernel函数不能正确执行，报错为： 图片

我的nvcc -V是11.6版本： 图片

并且根据pytorch官网安装了1.13.1的版本：conda install pytorch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 pytorch-cuda=11.6 -c pytorch -c nvidia

请问缺失的cudart如何进行正确的安装？

xiaol commented 1 year ago

325154699 加技术研发群

wywzxxz commented 1 year ago

解决了麻烦po一下方案

BlinkDL commented 11 months ago

@wpwpwpyo @wywzxxz export PATH=/usr/local/cuda/bin:$PATH export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH