allyourbot / hostedgpt

An open version of ChatGPT you can host anywhere or run locally.
MIT License
192 stars 75 forks source link

Thinking now signals waiting on API not server #271

Closed krschacht closed 1 month ago

krschacht commented 1 month ago

Occasionally the AI has hung and never responded. I just get an endless thinking.

I don't know if this is the server that is hung (i.e. job not getting picked up) or if this is the API that's hung. I suspect it's the API and I need to figure out a way to detect it and gracefully abort or retry.

As a first this PR alters the thinking animation so it gives me a clear signal. When the assistant's reply first renders there is no thinking animation. The thinking dot only begins once the job begins so thinking dot now clearly signals that it's now our server's fault.