Instructions on working with Oobabooga?

[blvckclxud]

Greetings again,

Sorry for hijacking another persons post! I like your interface a lot! I was trying to get it to work with oobabooga locally, but was having problems. I tried trouble shooting by myself over the past couple days. I wonder if there is a guide to get the whole thing to run locally with oobabooga and a Llamamodel? One is sending HTML and the other is waiting on a JSON that never comes.

I'm pretty new to this stuff and I'm learning a lot!

[kwaroran]

I'll gone a write instructions in readme in a week

[blvckclxud]

Thanks, will keep trying to figure it out on myt own till then.

[Alwaysfindtheway]

@blvckclxud https://arca.live/b/characterai/76070313?mode=best The video in this post is in Korean, but it might be helpful to you.

[blvckclxud]

Looks like you're running it with silly tavern, I will try that and see if it works.

[bcholewinski]

I'll gone a write instructions in readme in a week

I would like to ask if you were able to write a instruction?

[ganderhero]

Hi so in case anybody comes into this clueless about how to make Oobabooga work, all I had to do was install and make Oobabooga work, after that to allow RisuAI to work with Ooba you must input into your startup flags the '--no-stream' flag, make sure you have it and start Oobabooga. After Ooba is started, grab you API URL from what usually is the 2nd output line, it should be something like this: Starting API at http://127.0.0.1:5000/api Grab the API URL and then add /v1/generate after it, so it should be like this: http://127.0.0.1:5000/api/v1/generate After you get this new URL, just go into RisuAI's settings (Cogwheel) > Chat Bot > Model - Oobabooga WebUI and paste the modified URL into the TextGen Request URL field. Now Ooba should properly work with RisuAI!

Adding onto this, in case you are also confused about how making AUTOMATIC1111's Stable Diffusion WebUI work with RisuAI the steps are simpler, after you get the SD WebUI working by itself just get the local URL that it outputs to you usually on the last line of the first paragraph, which is by default: http://127.0.0.1:7860/ And then go to RisuAI's settings (Cogwheel) > Other Bots > Make sure the provider you selected is Stable Diffusion WebUI and then paste the URL you have into the WebUI Request URL field. Now the Stable Diffusion WebUI should properly work with RisuAI!

[blvckclxud]

Welp, ganderhero. That worked!~ Now I need to figure out how to actually use Automatic1111. Thanks for the help! ps: it was adding the http://127.0.0.1:5000/api/v1/generate that helped.

[karageee]

I added the http://127.0.0.1:5000/api/v1/generate but the output is Error: error in request:"TypeError: Failed to fetch" Looking at the ooba's log RisuAI requests OPTIONS into the ooba's API.

[blvckclxud]

I added the http://127.0.0.1:5000/api/v1/generate but the output is Error: error in request:"TypeError: Failed to fetch" Looking at the ooba's log RisuAI requests OPTIONS into the ooba's API.

did you configure ooba and risu correctly? set --no-stream in the startup flags?

[perkel666]

Thanks guys, you are gentelmen and scholars. Finally i was able to run ooba and risu.

check on in OOBA settings -no stream option use http://127.0.0.1:5000/api/v1/generate instead of Risu default OOBA setting.

[gamecp9]

-no streamhttp://127.0.0.1:5000/api/v1/generate,， please，Can you give a complete code? I'm a newbie and can't write it

[gamecp9]

Great thanks to babulee

the new oobabooga, the launcher is now called start_windows.bat instead of start-webui.bat In the old oobabooga, you edit start-webui.bat and add your flags after "call python server.py" like "call python server.py --auto-devices --chat" In the new oobabooga, you do not edit start_windows.bat but edit webui.py, which should be in the root of oobabooga install folder. You now look for this block of code

def run_model(): os.chdir("text-generation-webui") run_cmd("python server.py --api --no-stream")

then you append your new flags inside of "python server.py --api --no-stream"