Remove Bot Mention in Chat Query - Githubissues

kevinthedang / discord-ollama

Discord Bot that utilizes Ollama to interact with any Large Language Models to talk with users and allow them to host/create their own models.

Creative Commons Attribution 4.0 International

42 stars 4 forks source link

Remove Bot Mention in Chat Query #40

Closed kevinthedang closed 2 months ago

kevinthedang commented 2 months ago

Issue

Sometimes when you perform a query on the bot, it can hallucinate because of its own user_id it has in the chat query.
It would be nice to prevent this "possible" hallucination chance by getting rid of the mention

Solution

Parse the user prompt to slice away the Discord bot's user_id.
We can even add a user preference for using "mentions" to talk with the bot. **(Server Preference or User Preference?)
Note: The bot ID can be anywhere in the string, which can be annoying, but we have to account for it
- At beginning ? Slice once : (...
- In between ? Slice twice : (...
- At end ? Slice once : ...