search

mercm8 / chat-llama-discord-bot

A Discord Bot for chatting with LLaMA, Vicuna, Alpaca, or any other LLM supported by text-generation-webui or llama.cpp.
https://discord.gg/TcRGDV754Y
MIT License
16 stars 4 forks source link

Making extentions work with the bot. #7

Closed MuXodious closed 1 year ago

MuXodious commented 1 year ago

Is it possible to make extentions like EdgeGPT work with the bot? So far from my observations bot.py doesn't load any extentions even when specified as arguments. It would be nice to have things like "superbooga" and "EdgeGPT" working.

mercm8 commented 1 year ago

I honestly have no idea, I'm not using extensions myself. I'll look into it but can't really make any promises. A guy on discord said I could just throw in extensions_module.load_extensions() and that should take care of it. We'll see.

MuXodious commented 1 year ago

Hey! Thank you for your hard work. I have been looking in to the matter. I must say that I'm just someone who can read code not write before I continue. I managed to get the extensions load, but I'm not sure if they're working as they're intended to be. Here:

image

Here's the changes to get this result:

https://github.com/MuXodious/chat-llama-discord-bot/commit/b68fa569748ba9928eb65d6724abf40c3957113d

Edit: I think, stuff like xformers are also working. Here's my launch command:

python bot.py --xformers --extensions superbooga EdgeGPT

mercm8 commented 1 year ago

Looks promising! I'll look into this (and extensions in general) over the weekend.

Would be kinda cool to get the tts extensions working over voice channels for example.

MuXodious commented 1 year ago

No rush ^^. Again, thank you for your time. Indeed, It would be nice to enable STT and TTS plugins then invite the bot to a voice channel, where we can have a conversation or use it as a voice assistant/voice-activated assistant. Let me know if you need someone to test something or have anything that I can help with. Perhaps, I'll try loading STT, TTS, and some other extensions and see what happens in the mean time. I can open a pull request too, If you want to continue from there instead of this issue.

So far I made some changes to EdgeGPT's script.py and extension does work, but errors out as following when called, might be an incompatibility with the bot but leaving here for reference. 

custom_generate_chat_prompt.<locals>.EdgeGPT' was never awaited
  await self.on_error(event_name, *args, **kwargs)

One last thing, I identified a bug where bot when launched without A1111, spams the following excerpt to the chat non-stop until it's turned off.

Launch Automatic1111 with the --api commandline argument\nRead more [here](https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/API)

bot

mercm8 commented 1 year ago

yeah that was a nasty one, just discovered it myself, should be fixed now though

mercm8 commented 1 year ago

also I think discord api doesnt allow for bots to record audio from voice channels, unfortunately

mercm8 commented 1 year ago

go ahead with the pull request btw if it's working for you - I'll get back to it over the weekend, havent even used an extension yet myself so hard to test if it's working as intended when I don't know how most of them should work