search

josStorer / RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
https://www.rwkv.com
MIT License
5.1k stars 489 forks source link

/chat/completion returns invalid json #92

Open UnknownAMD opened 1 year ago

UnknownAMD commented 1 year ago

im trying to use auto gpt with rwkv via rwkv-runner but it keeps failing because the json /chat/completion returns is not the json auto gpt expects

josStorer commented 1 year ago

I think this problem is from the model itself. I checked the logs and this is the response provided by RWKV. In complex situations, accurate JSON format cannot be generated at present. Although RWKV Runner provides a compatible API, accurate generation of the specified JSON format is still difficult for RWKV's chat mode, and you may have to use instruction mode or finetune the model.

image