search

josStorer / RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
https://www.rwkv.com
MIT License
5.32k stars 504 forks source link

linux 模型运行失败 #386

Open 0xHertz opened 2 months ago

0xHertz commented 2 months ago

在ubuntu24.04系统中，下载runner客户端并安装所需python依赖后 命令行运行python main.py可以正常启动 Screenshot from 2024-09-05 16-08-23 但是在runner客户端点击运行，显示启动中后直接结束，并没有运行起来 Screenshot from 2024-09-05 16-08-49 Screenshot from 2024-09-05 16-08-54 我的主机没有GPU，不知道是否是必须的

0xHertz commented 2 months ago

无报错信息

josStorer commented 2 months ago

试试自己调用 /switch-model 载入模型, 可以看到详细的控制台错误输出, 如果进程直接崩溃, 可能是载入的模型太大, 内存不足

0xHertz commented 2 months ago

Screenshot from 2024-09-06 17-13-54

0xHertz commented 2 months ago

调用 /switch-model 后具体的报错截图如上，是否有解决方案，谢谢

0xHertz commented 2 months ago

更多信息 Screenshot from 2024-09-06 17-18-04

josStorer commented 2 months ago

看着像是内存不足， 进程直接被杀了

0xHertz commented 2 months ago

换了更小的模型，还是同样的问题 Screenshot from 2024-09-09 14-43-18