Chat Queue Persistence - Githubissues

kevinthedang / discord-ollama

Discord Bot that utilizes Ollama to interact with any Large Language Models to talk with users and allow them to host/create their own models.

Creative Commons Attribution 4.0 International

42 stars 4 forks source link

Chat Queue Persistence #33

Closed kevinthedang closed 3 months ago

kevinthedang commented 3 months ago

Added

Queue class to handle the queueing of user messages to reduce generation time, this is currently set as 5 and should probably be set as a "User Preference" for how long the bot's memory should be for them.

Update

Readme with some center formatting.
Ollama and Discord Icon added to the top for visuals.
Added the goals in the Readme and moved the about down about what Ollama is.

Note

Testing the Queue process out was done on my laptop and not a high grade server, it was a bit difficult to determine performance.

kevinthedang commented 3 months ago

For Latest Commit

Fix

Shutdown issues were found and now fixed with simpler if statements! Wanting to be cool caused issues :(