开启CUDA算子后启动切换模型失败 - {"detail":"failed to load: list index out of range"} 切换模型失败 - {“详细信息:"无法加载:列表索引超出范围"}

josStorer / RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

https://www.rwkv.com

MIT License

5.31k stars 502 forks source link

开启CUDA算子后启动切换模型失败 - {"detail":"failed to load: list index out of range"} 切换模型失败 - {“详细信息:"无法加载:列表索引超出范围"} #361

Open lukiugi opened 4 months ago

lukiugi commented 4 months ago

lukiugi commented 4 months ago

关闭CUDA算子后启动报错“错误的PyTorch版本，请重新安装CUDA版本的PyTorch 请问该如何操作？