search

marcusschiesser / unc

Enterprise-ready, privacy-first ChatGPT platform
https://unc.de
GNU Affero General Public License v3.0
7 stars 1 forks source link

[Feature] Add suggestions to chat #6

Open marcusschiesser opened 11 months ago

marcusschiesser commented 11 months ago

Add suggestion feature to bots (default is on - can be turned off in bot settings).

The feature is that after the AI has finished its message, up to 4 likely user messages are generated and given to the user as an option:

image

The suggestions are of course generated by the AI model. As prompt start with something like: Generate a list of up to 4 likely responses to the current conversation

LaDoger commented 11 months ago

I personally never use this feature. Maybe directly generate a follow up question in the text input box as a grey prefill thing (when you click on it it clears, but if you press enter it gets sent) would work better?

marcusschiesser commented 11 months ago

@LaDoger I also never use it. I don't think it's a big priority then. Also, it would add additional LLM calls (therefore it definitely should be an option). I like your alternative suggestion, but the complexity is similar as we have to do one additional LLM API call (but of course with fewer tokens).