Closed Raikiri closed 1 year ago
Update: further testing revealed that the problem affects specifically ggml-vic7b-uncensored-q4_0.bin and does not affect ggml-vic7b-q4_0.bin
Seems like a problem with the model, and the ui should show that the message ended.
Describe the bug I have setup catai, downloaded a model, the web interface opens up, I see this in the console of the server:
but as soon as I type anything in the web interface, the circle starts spinning indefinitely and this pops up in the server log:
Desktop (please complete the following information):
PS i clearly have no idea what i'm doing, so the problem is likely on my side, but I don't know what to try