search

kartikm7 / llocal

Aiming to provide a seamless and privacy driven chatting experience with open-sourced technologies(Ollama), particularly open sourced LLM's(eg. Llama3, Phi-3, Mistral). Focused on ease of use. Available on both Windows and Mac.
https://www.llocal.in
MIT License
92 stars 14 forks source link

Display when the model is changed during a conversation #9

Open albertotn opened 3 months ago

albertotn commented 3 months ago

Scenario: I'm evaluating a model locally (performance and quality of the messages) and I need to keep track of which model I'm using and when.

A possible solution could be to track model change in a chat, similar when someone join/left a conversation in message system, like for example:

model llama2:latest is changed to model llama3.1:latest

So I'm aware of these changes

kartikm7 commented 3 months ago

Hello @albertotn ! This seems like a great quality of life feature, will try to implement this. It would require some refactoring with how the schema is in the DB might need to make a new one. But will look into this for sure.

Thanks for the suggestion!