search

alexrozanski / LlamaChat

Chat with your favourite LLaMA models in a native macOS app
https://llamachat.app
MIT License
1.43k stars 53 forks source link

Feature request: Automatically stop generation #23

Open TrajansRow opened 1 year ago

TrajansRow commented 1 year ago

It would be nice to have an option to automatically stop generation after a random number of 1-n sentences, delimited by punctuation followed by whitespace. Additionally, it may be helpful to have a "Stop generation at end of sentence" button as an alternative to the current control in the chat window.

TrajansRow commented 1 year ago

Change to this request: Simply expose the reverse-prompt input, which in combination with #17 should provide a versatile method of controlling generation.

alexrozanski commented 1 year ago

@TrajansRow yep good shout. Prompt context is something I want to tackle for the next version so will add it to the list