openaustralia / yinyo

A wonderfully simple API driven service to reliably execute many long running scrapers in a super scaleable way
https://yinyo.io
Apache License 2.0
6 stars 1 forks source link

For clay server check that S3 bucket exists on startup and if it doesn't then exit #67

Closed mlandauer closed 4 years ago

mlandauer commented 4 years ago

The current behavior is much more confusing. It only errors on certain API requests that access the S3 bucket.

That mixed with the lack of error checking in the current clay client means that the user has little chance of spotting the error.