Open kisamoto opened 1 week ago
While showing a loading indicator and then getting the full message works, it's not ideal. Especially if the model takes a long time to generate the output.
For better UX we should switch to streaming mode.
While showing a loading indicator and then getting the full message works, it's not ideal. Especially if the model takes a long time to generate the output.
For better UX we should switch to streaming mode.