search

chrisrude / oobabot-plugin

A Discord bot plugin to text-generation-webui, based on oobabot.
https://github.com/chrisrude/oobabot
MIT License
41 stars 11 forks source link

readme

Oobabot-plugin

oobabot is a Discord bot which talks to a Large Language Model AIs (like LLaMA, llama.cpp, etc...), running on oobabooga's text-generation-webui.

This is a plugin which allows oobabot to run from within the text-generation-webui server, and offer a web interface to the bot.

python lint and test with poetry

Installation

  1. Install oobabooga/text-generation-webui, and get a model running on it.

  2. from a command prompt, activate the same conda environment you used to install text-generation-webui, and install the plugin from PyPi:

    conda activate textgen
pip install oobabot-plugin

  3. Then just run this to create the oobabot plugin directory (./extensions/oobabot) and install the plugin's hook (script.py) into the Oobabooga server:

    oobabot-plugin install

  4. Finally. restart the Oobabooga enabling the both the oobabot plugin and the API plugin. E.g.:

    python server.py --extensions api oobabot

    Hopeful success! You should now see a new "oobabot" plugin under the "interface mode" tab.

Preview

image

Motivation

There are a number of Discord bots which can talk to a Large Language Model AI, but many take a lot of setup. I think this technology is amazing, and I want to make it easy for anyone to experience it by running their own bot, which they can own and customize to their own needs.

If you have any issues, suggestions, or comments, please file an issue in github Have fun!