Feature request-: Make it a extension in text generation webui

chrisrude / oobabot

A Discord bot which talks to Large Language Model AIs running on oobabooga's text-generation-webui

MIT License

101 stars 34 forks source link

Feature request-: Make it a extension in text generation webui #11

Closed TruthSearchers closed 1 year ago

TruthSearchers commented 1 year ago

A feature request ,it will be cool if you make this as extension of ooobaboga (text generationwebui) so we can run it simultaneously with text generation web ui

That will be cool There is telegram bot like this as extension

chrisrude commented 1 year ago

It's getting close! bot-ui

chrisrude commented 1 year ago

Still needs some more tweaking, particularly integration with some of the conversational model settings now that I can read them more easily.

Then to see if I can get it landed as a default plugin!

TruthSearchers commented 1 year ago

Ohh damn , thanks men

chrisrude commented 1 year ago

Ok, I need some help testing. Anyone interested?

To do so:

go to your oobabooga install directory, (text-generation-webui)
activate your conda environment if necessary
run:
```
pip install oobabot-plugin
```
a bunch of stuff should be installed
then run:
```
oobabot-plugin install
```
You should see something like:
```
oobabot installed!
Please restart the server and enable the oobabot plugin.
```
Then, do that! You should see a new "oobabot" plugin under the "interface mode" tab.

Enable it, along with the API plugin if you haven't already. Now you should have a new "oobabot" tab on the top that looks like this:

Have fun, and please post here what worked and what didn't. I would love it if some of you wonderful folks could help let me know if / how it works before spreading the word more broadly.

TruthSearchers commented 1 year ago

I will try it out

TruthSearchers commented 1 year ago

Hey there bro i just tried it out First of all it's amazing works perfectly There is some issues i faced and noticed i) Ui ( upper part of ui (section in which start oobabot and stop oobabot and some lines are hiding behind) (these buttons only half visible)(it's possible that it's issue only from my side because i am using different theme) ii) when i close (uncheck) oobabot in interface mode , it don't close instead , don't able reload ui again

---Add more options such as max_tokens and other params (or take as it is from parameters tab in web ui) Some more stable diffusion options such as negative prompt , sampler , steps etc

Also a suggestion if possible (text streaming is not smooth ) (like it stop streaming sometimes in middle etc)

chrisrude commented 1 year ago

Awesome, thanks for trying it out!

i) Ui ( upper part of ui (section in which start oobabot and stop oobabot and some lines are hiding behind) (these buttons only half visible)(it's possible that it's issue only from my side because i am using different theme)

It would be helpful if I see the problem in a bit more detail. Would you mind sending a screenshot of the problem?

ii) when i close (uncheck) oobabot in interface mode , it don't close instead , don't able reload ui again

yeah, I looked into this a bit already and it's a gradio issue. I might try and see if I can work around it on my side, or land a fix there. But it's something I want to fix before pushing this out more broadly.

Also a suggestion if possible (text streaming is not smooth ) (like it stop streaming sometimes in middle etc)

Yeah, I think I might hide it from the UI for now.

chrisrude commented 1 year ago

the restart issue is fixed, and the streaming option is hidden. Can look at the rendering issue if / when I get a screenshot, though if it's just a custom skin issue there might not be anything to fix.

chrisrude commented 1 year ago

Calling this done as 0.1.9 of https://github.com/chrisrude/oobabot-plugin is out! Please file any requests for that package in that respository.