BrutalCoding / shady.ai

Making offline AI models accessible to all types of edge devices.
https://www.shady.ai/
GNU Affero General Public License v3.0
126 stars 11 forks source link

Add chat UI plugin for basic interface #9

Closed BrutalCoding closed 1 year ago

BrutalCoding commented 1 year ago

I've implemented a Q&A style UI, not chat. This will suffice for the time being until I'm happy with the full implementation. Chat feature comes next after the current Q&A feature. Chat is a bit more complex because it will require -i (interactive) mode, careful attention to end of sentence tokens etc. To be clear: It's unclear to me exactly how to implement this, this is quite hard stuff to wrap your head around with hahaha.