I think it would be very useful to be able to stop the model from generating output using a button in the chat interface.
Currently I have to wait until the model is done with generating output, even when I already know the generated output is not of interest to me, costing valuable compute time.
Hi @ThimbleThings, thank you for bringing up this interesting feature request. I will certainly explore the feasibility of this feature and look into ways it could be integrated.
I think it would be very useful to be able to stop the model from generating output using a button in the chat interface. Currently I have to wait until the model is done with generating output, even when I already know the generated output is not of interest to me, costing valuable compute time.