Closed larsyencken closed 7 months ago
Hypotheses:
fetchS3MetadataByPath
and fetchS3DataValuesByPath
both seem to check for 200 responses and catch exceptions, logging them more gracefullyTried a local bake, I got a HTTP 500 from DigitalOcean spaces with a nice stack trace.
After getting rid of workerpool in baking, the stack trace is clearly visible, showing 500 errors from CF workers. The bug is pretty dumb - retryPromise
doesn't wrap response.ok
check, so if there's a 500 (that doesn't result in error in fetch
), it won't retry anything. The fix is here.
Problem
Baking occasionally fails with
SyntaxError: Unexpected token < in JSON at position 0
Stack trace
https://buildkite.com/our-world-in-data/owid-deploy-code-master/builds/360#018dc107-523c-4305-82b5-88b44046e2e4