search

xNul / chat-llama-discord-bot

A Discord Bot for chatting with LLaMA, Vicuna, Alpaca, MPT, or any other Large Language Model (LLM) supported by text-generation-webui or llama.cpp.
https://discord.gg/TcRGDV754Y
MIT License
118 stars 23 forks source link

Problems with / commands. #1

Closed GustavRaispits closed 1 year ago

GustavRaispits commented 1 year ago

I've recently set up ooba text-generation-webui with 4bit patch and the site works correctly, I'm using llama-13b-hf. I'm trying to run bot.py using miniconda through the textgen env with python 3.10.10, what are the required modules for making chat-llama-discord-bot work correctly? I didn't find any requirements.txt file for installing every module. myz9YWh It says that the slash command is not valid, looks like that some / commands "disappears" when using the /reset or /index reset commands.

That's what happens when I try to use /reply without using the /reset command for making the initial prompt:

2Pg8ppq

Sometimes the CMD doesn't even output errors when the / commands "crashes"

02nS8wp

I believe that this repo got great potential, hoping to get a response!

xNul commented 1 year ago

I think the problem in the first screenshot was happening because the commands from your bot hadn't registered with Discord yet. It takes a few minutes before they will work with a new bot.

For the second problem, it looks like text-generation-webui updated again. It updates every few days with breaking changes to both the install instructions and the internal API I'm leveraging because of how much development there is going on with LLaMA atm.

xNul commented 1 year ago

I've applied a fix for the text-generation-webui breaking changes in this commit https://github.com/xNul/chat-llama-discord-bot/commit/a14deeff25fc521b14f50e918486e7d7e0387936. Thanks for reporting the issue and hope you enjoy the bot!