netlify[bot]
commented
1 month ago Deploy Preview for foyle canceled.
| Name | Link |
|---|---|
| Latest commit | 8aabb0ea00fd8daed7d4a583ab1b8d307ecf2b1d |
| Latest deploy log | https://app.netlify.com/sites/foyle/deploys/67102a785f4a1f00088307cc |
During evaluation we are seeing ocassional timeouts on the server due to the HTTP read/write timeout occuring. It looks like this might happen because ChatGPT takes a really long time to respond occassionally.
Update StreamGenerate and GenerateCells to return DeadlineExceeded to indicate a server timeout
Implement a unaryinterceptor to automatically retry requests based on the status code.
The retry is pretty simplistic; its a fixed backoff.
Fix a bug in Agent.go where we aren't correctly logging one of the level1 assertions.