A cancel generation button would be useful, because sometimes you click search and it starts generating text which is not going in the direction you want.
I can usually notice this within the first couple of sentences, even though the default of the bot is to generate like 3-4 paragraphs.
So it's better to just not waste tokens and cancel the query.
A cancel generation button would be useful, because sometimes you click search and it starts generating text which is not going in the direction you want.
I can usually notice this within the first couple of sentences, even though the default of the bot is to generate like 3-4 paragraphs.
So it's better to just not waste tokens and cancel the query.