v2rockets / Loyal-Elephie

Your Trusty Memory-enabled AI Companion - Multilingual RAG chatbot optimized for local LLMs | OpenAI API Compatible
MIT License
208 stars 19 forks source link

'hands-free' mode #14

Open hennas-waifson opened 1 week ago

hennas-waifson commented 1 week ago

Hello! I have been using the assistant for almost a month now, and it has been great! What sets Elephie apart is its ability to comprehend and a memory that actually works well.

For an even deeper integration into one's workflow, it would be nice to have 'a hands-free mode' that would allow one to use the assistant without interrupting the current task = being able to stay on whatever window they are working in and communicate with the assistant.

For example, while working in a word document, pressing a key combo and asking the assistant a question via a voice. User while typing the paper: "what are the major schools of thoughts in economics?" Assistant: "There are a few major schools of thought in economics. Classical Economics - This school..." User has an option to continue same convo by repeating the key combo and speaking.

Asking the assistant about the contents of the clip-board. For example, the user ctrl-copies an email then asks the assistant as above with a clipboard-function-specific key combo 'Draft a response to this email'. Assistant responds with a draft. This way assistant can be asked about anything that can be copied into the clip-board, such as a news article, a web page, a text to proofread and keep it as part of a convo with the user.

Saving the conversation from any window by pressing a key combo.

Maybe saving the contents of the clipboard into notes, using a key combo, without having to go to the assistant's window.

The above will effectively make the assistant universally accessible throughout the operating system. Regardless of what window the user is working in, they will be able to take advantage of the assistant's functionality.