Out of subject Question

[TruthSearchers]

First of all sorry men its not a question related to oobabot Yo bro @chrisrude I was working with api of ooobaboga , I don't know how to use it kinda confused In oobaboga I want to use api just like you used for discord bot to generate reply Actually I have gpu and my friend dont have gpu and he want to try the oobaboga so i thought if I can just use oobaboga api like you used to generate reply in oobaboga and no problem in using with extensions which use api like oobabot too

I mean in models tab as fake loader to add api and load it and can be used as model but i don't how to do it

If you can tell how to do it as you using api too for oobabot i thought I ask you directly Thanks :)

[chrisrude]

Glad you're excited about writing stuff!

I'd recommend checking out this example: https://github.com/oobabooga/text-generation-webui/blob/main/api-examples/api-example.py

You'll need to set HOST to a hostname your friend can access, but otherwise should work as a starting point. Good luck!

[TruthSearchers]

Thanks bro I created a fake model loader which can load openai api key or key with base url (api url) it's working , but problem coming it's not streaming in oobaboga due to some reason plus not able stream correctly and not working with oobaboga api extensions

i know you are busy but If you can have little bit of time can you please check the problem/bug , I don't able to find it kinda confusing alot

@chrisrude