withcatai / catai

Run AI ✨ assistant locally! with simple API for Node.js 🚀
https://withcatai.github.io/catai/
MIT License
443 stars 28 forks source link

<end> after sending any message in the web interface #23

Closed Raikiri closed 1 year ago

Raikiri commented 1 year ago

Describe the bug I have setup catai, downloaded a model, the web interface opens up, I see this in the console of the server:

new connection

but as soon as I type anything in the web interface, the circle starts spinning indefinitely and this pops up in the server log:

<end>

Desktop (please complete the following information):

PS i clearly have no idea what i'm doing, so the problem is likely on my side, but I don't know what to try

Raikiri commented 1 year ago

Update: further testing revealed that the problem affects specifically ggml-vic7b-uncensored-q4_0.bin and does not affect ggml-vic7b-q4_0.bin

ido-pluto commented 1 year ago

Seems like a problem with the model, and the ui should show that the message ended.