josStorer / RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
https://www.rwkv.com
MIT License
5.25k stars 499 forks source link

Load state with API in server mode? #401

Open XDcsy opened 5 days ago

XDcsy commented 5 days ago

看到桌面版是可以在设置页面加载 state 的 #391 想请问一下在Liunx上跑的后端是否也支持通过API调用加载state,就像载入模型那样?

josStorer commented 5 days ago

/update-config可以传state动态修改state https://github.com/josStorer/RWKV-Runner/blob/master/backend-python/routes/config.py#L113