Removed Ollama API Threads as an Option

kevinthedang / discord-ollama

Discord Bot that utilizes Ollama to interact with any Large Language Models to talk with users and allow them to host/create their own models.

Creative Commons Attribution 4.0 International

42 stars 4 forks source link

Closed kevinthedang closed 3 weeks ago

kevinthedang commented 3 weeks ago

Threads as an option for the /chat API endpoint from ollama. This should allow ollama/the system to decide how many threads it should utilize.

The workflows "dispatched" at the incorrect instances. That is now fixed as Unit Tests should be ran in PRs prior to merging to validate incoming code.