search

brilliantlabsAR / noa-assistant

ISC License
154 stars 19 forks source link

Handle timeouts with retry #3

Closed trzy closed 2 months ago

trzy commented 3 months ago

Need to detect timeouts and respond appropriately with retry and/or error. The best way to detect timeouts is to use the streaming completions API and reset the timer for every token received. If no tokens received for e.g. 60 seconds or whatever, retry, or eventually fail with a message.

josuah commented 3 months ago

It looks like timeouts errors also happen from the "resend OTP" button: