Remove Bot User ID from Message Prompt - Githubissues

kevinthedang / discord-ollama

Discord Bot that utilizes Ollama to interact with any Large Language Models to talk with users and allow them to host/create their own models.

Creative Commons Attribution 4.0 International

42 stars 4 forks source link

Remove Bot User ID from Message Prompt #48

Closed kevinthedang closed 2 months ago

kevinthedang commented 2 months ago

Fixes

Bot client-uid not longer a part of a user prompt. This used to cause problems with hallucinations where the bot would not address the prompt because the message had "sensitive information" in it.
Also prevents cases of the bot hallucinating for now reason.
Possibly improves computation time because it removes unnecessary information that could confuse the model.

Sample Hallucination