josStorer / RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
https://www.rwkv.com
MIT License
5.27k stars 502 forks source link

無法再TavernAI中使用 #136

Closed win10ogod closed 1 year ago

win10ogod commented 1 year ago

如何在TavernAISillyTavern中使用api?

flasewazard commented 1 year ago

相同问题,实际上我看runner的cmd里是报说tavern的api get请求有发送到,但是会因为请求下属的/models文件夹所以runner会404,有结果了踢我一脚

flasewazard commented 1 year ago

我从别人那边薅了两个项目,还没试过https://github.com/xiaol/TavernAI-RWKV和https://github.com/xiaol/SillyTavern-RWKV 你逝世看?

VonKauland commented 1 year ago

image 反向代理中填寫http://127.0.0.1:8000/v1後,按Test Message按鈕可以生成一段對話。但是如果按的是Connect按鈕,會提示Endpoint not found.

KaJ1L commented 1 year ago

我从别人那边薅了两个项目,还没试过https://github.com/xiaol/TavernAI-RWKV和https://github.com/xiaol/SillyTavern-RWKV 你逝世看?

可以用的,反代里填上rwkv runner上的api就行了

flasewazard commented 1 year ago

我从别人那边薅了两个项目,还没试过https://github.com/xiaol/TavernAI-RWKV和https://github.com/xiaol/SillyTavern-RWKV 你逝世看?

可以用的,反代里填上rwkv runner上的api就行了

会报错,类似 @}O@CA~JFQWHVM~%`BE}5`9 这个样子

flasewazard commented 1 year ago

我从别人那边薅了两个项目,还没试过https://github.com/xiaol/TavernAI-RWKV和https://github.com/xiaol/SillyTavern-RWKV 你逝世看?

可以用的,反代里填上rwkv runner上的api就行了

显而易见的就是,会GET这个models,然后就读不到了,我不知道在哪里改请求,可以的话请大佬指点一下

josStorer commented 1 year ago

我下版本加一下models API

josStorer commented 1 year ago

https://github.com/josStorer/RWKV-Runner/releases/tag/v1.4.4

flasewazard commented 1 year ago

https://github.com/josStorer/RWKV-Runner/releases/tag/v1.4.4

感谢,已经可用了

flasewazard commented 1 year ago

我下版本加一下models API

反馈一下,不知道是没有确认请求的返回还是什么原因,当runner生成较长回复时tavern可能先报错超时,但是能正常收到回复结果,较短回复则无问题

LSXAxeller commented 1 year ago

anyone successfully started it ? I tried to launch TavernAI using RWKV Runner AI using different api urls but no luck, only receive "200 OK" after removing all the "api/v1" from server.js but still not connected

image

josStorer commented 1 year ago

@LSXAxeller Use this Settings:

image