DeSinc / SallyBot

AI Chatbot coded in Discord.net C#
MIT License
299 stars 51 forks source link

JSON Errors when using Oobabooga Text Generation #27

Closed VSS-Vintorez closed 1 year ago

VSS-Vintorez commented 1 year ago

My only modification was commenting the only display the first line of error for a detailed report. Error: image OS: Windows 10 22H2 Oobabooga installed with the 1-click installer, with xformers. It works just fine on Dalai, but I want to use my GPU for both Text Generation and Stable Diffusion

DeSinc commented 1 year ago

hmm. I just updated by oobabooga and ran sallybot and it seems to work ok for me on this end. My only suggestion would be to try update ooba on your end first, then after updating if it still doesn't work, verify the webui works to generate text.

Also, make sure you are using the right args on your oobabooga, which now needs to be written in the webui.py file in the main ooba folder with all the .bat files now. Check readme (github main page for sallybot) at the ooba instructions section and you'll see we updated them to reflect the new process now, and all the args that you need to paste in are there

DeSinc commented 1 year ago

P.S: you have to use --extensions api on oobabooga for now as default API was giving me bugs and does not work right.

I get the feeling ooba cycled around to using the default API here and is getting the json bug I mentioned. Try restarting sallybot and as long as --extensions api is running on ooba, it should connect.

VSS-Vintorez commented 1 year ago

I was using --extensions api but I found the issue, other apps taking up the ports and needing to update it, Thanks!