search

reality-comes / discordrp

DiscordRP is a Discord bot that utilizes LLMs to engage in complex multi-character roleplaying
Apache License 2.0
4 stars 0 forks source link

Anyways to get this working with ollama #1

Open TheMindExpansionNetwork opened 4 months ago

TheMindExpansionNetwork commented 4 months ago

Kind of a noonish I really dig what your doing but open ai going to be adding quick when releasing to madness I want to use open source is there ways to do this only with the ollama

reality-comes commented 3 months ago

Yes, I just pushed update to dev branch that supports ollama. I added some support for it a while back and never updated. Let me add some documentation for it.

reality-comes commented 3 months ago

I added ollama support for embeddings, between that and koboldcpp you can do everything locally. I added documentation on how to switch to it in the readme. To edit ollama settings you will need to change them in embeddings.py (for instance switching the ollama model or the url.)