search

darrenburns / elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
Apache License 2.0
1.88k stars 116 forks source link

Please add a way to stop/cancel the inference, and Suggestions #49

Open LFd3v opened 6 months ago

LFd3v commented 6 months ago

Hi, there!

Nice project! Thank you for developing and maintaining it!

Maybe I missed something in the help, but is there a way to cancel an inference? If not, I think this could be really useful, specially when trying models locally (specially the big ones that may run very slowly).

Some suggestions (please feel free to ask me to open a separate issue for the ones you may be implemented):

  1. Option to delete chat
  2. Add a secondary keybinding to send a message, maybe Shift + Enter or Ctrl + Enter. Personally, I would prefer that it worked like some messengers can be configured: Enter to send and Shift/Ctrl+Enter to add a line break (maybe add a preference for this?)
  3. Other options to the app "theme"
  4. Tune some variables per chat, like system prompt, temperature, etc
  5. Export the chat (as a MarkDown file?)
  6. Add image to the chat (for multimodal models)

Thanks again. Regards

darrenburns commented 2 months ago

Hey, sorry for the delay.

  1. You can press a when highlighting a chat on the home screen to archive it (it will remain in your local database but is hidden from the UI).
  2. I've added alt+enter in the latest version, but support is down to your terminal. Customisable keymaps will be available in the coming months.
  3. I've added support for custom themes in the latest version.
  4. Good idea! Right now you can change the system prompt in ctrl+o menu from the home page, and that will apply for the remainder of the session. It'll be set back to your config file prompt in the next session however.
  5. Good idea!
  6. This may come in the future but it's not a priority for me as I don't really use any multimodal stuff. Happy to accept contributions though!