Especially when the API Errors. I'm not sure all the ways the API errors, but some that I've seen.
The streaming starts but just stops
The API doesn't get all the inputs from the app. Seems like this can be if you type something in a streamlit box and hit submit without giving the app time to "register" the input.
You get various API error messages, like this one:
Especially when the API Errors. I'm not sure all the ways the API errors, but some that I've seen.