h1ddenpr0cess20 / ollamarama-matrix

AI chatbot for Matrix with infinite personalties, using ollama
GNU Affero General Public License v3.0
23 stars 2 forks source link

Bot does not react #32

Open KeenMaron opened 1 week ago

KeenMaron commented 1 week ago

Hi, Any idea why the bot does not react? Maybe a misconfiguration? The console says it is successfully logged in and joined the specified room. The login and room join messages are displayed correctly, and the account appears online. However, when I write a message like .ai hi or @botname hi, I don’t get any reaction, and there are no error messages in the console.

h1ddenpr0cess20 commented 1 week ago

i have never had this issue and can only speculate that it's an issue with your ollama installation. please make sure that you have ollama installed and configured properly and you have a model downloaded that your system has the ability to run. if you do not have a decent GPU, these will take a very long time to generate responses. make sure the model is in the config. you'll want to replace the ones i have there currently, they're a bit out of date since last updating it. if you're low on system resources i would suggest trying a 1b or 3b model, like llama3.2, and experimenting with different quantization levels to see what works for you.

KeenMaron commented 1 week ago

Ok, I figured out what the problem is. The bot only responds in channels without encryption. Did I miss something in the configuration? Is it possible to use the bot in encrypted channels?

h1ddenpr0cess20 commented 1 week ago

I have not tested in encrypted channels. I probably should. For that you need to install libolm and then install matrix-nio[e2e] I built this with the matrix-nio without end-to-end encryption support. based on what i can see, it should work after installing those things, but i'll do some testing this afternoon to make sure. https://github.com/matrix-nio/matrix-nio?tab=readme-ov-file#installation

h1ddenpr0cess20 commented 1 week ago

okay i've done some testing and searching and it appears i will need to spend a bit of time learning about verifying devices before this will work with encrypted channels. once i've done that i'll update the bot. if you figure it out on your own before i get to it, feel free to send a pull request.

KeenMaron commented 5 days ago

Hey, I have implemented the use of the bot in encrypted rooms. However, the bot's authentication is still a bit messy, so it will always appear as an unauthenticated user. Apart from that, it works.

h1ddenpr0cess20 commented 5 days ago

i'll look into improving authentication for the next update. thanks for pointing it out.