search

ausboss / PygDiscordBot

Discord bot that uses KoboldAI. Supports tavern cards and json files.
63 stars 29 forks source link

ERROR: Response: <Response [404]> #43

Open RSAStudioGames opened 10 months ago

RSAStudioGames commented 10 months ago

I keep getting "ERROR: Response: <Response [404]>" whenever I send a message in the channel. The bot detects and knows what I last sent and it also shows that it is typing, but it never sends anything.

I'm running the backend on Oobabooga and its all on a linux 20.04 LTS server. I've use the bot before on other machines and it has worked before with the same model. Not sure why it's acting up now.

I checked through the code, it looks like it's showing as an issue with the stop sequences, but I've even gone as far as completely removing all of them so I'm out of ideas.

Sbaero commented 9 months ago

I'm finding that Ooba changed the API sometime in November.

https://github.com/oobabooga/text-generation-webui/issues/4630

See the link Ooba linked on how to get the legacy API running if you don't want to migrate to OpenAI format

The error comes from line 227 of textgen.py since it's calling the old API which no longer exists, so 404's.

url = f"{self.model_url}/api/v1/generate"

ktfcaptain commented 8 months ago

Did something else break then? I found this after spending days getting oobabot going and neither will actually work once running.

Sbaero commented 7 months ago

I was able to follow the directions ooba listed to use the legacy api and it worked in my discord bot. Must be something on your end. (UNLESS you pulled more recently than Feb 4th when I tested this, which might have broken something else. In that case I don't know)