nextcloud / assistant

✨ Nextcloud Assistant
GNU Affero General Public License v3.0
23 stars 4 forks source link

Add model info for transparency #102

Open nimishavijay opened 1 month ago

nimishavijay commented 1 month ago

Describe the feature you'd like to request

Currently the end user has no control over or even knowledge of which LLM is being used in the assistant. This is a potential privacy concern as the user may believe that the LLM being used is open source and ethical, and send sensitive data as input, while in reality the admin may have chosen an LLM that would use the user's data without their consent.

Describe the solution you'd like

Add a clear indication of the LLM being used which is visible to every user who opens the assistant. This can be something as simple as a "powered by [model name]" in --color-text-maxcontrast next to the assistant chip

Describe alternatives you've considered

Also show the ethical AI rating with a little infobox with explanation.

jancborchardt commented 1 month ago

Discussed and Frank mentioned this would be good for the Settings → Privacy section to list there which model is being used. Including if it sends data to an external provider.