openaustralia / yinyo

A wonderfully simple API driven service to reliably execute many long running scrapers in a super scaleable way
https://yinyo.io
Apache License 2.0
6 stars 1 forks source link

For clay example client store build cache locally in the same directory as the scraper #71

Closed mlandauer closed 4 years ago

mlandauer commented 4 years ago

This has the advantage of not needing any "special" caching directories locally rather we just have a simple naming convention that indicates a certain hidden file is always the build cache.

We would need to make the following changes: