While it is possible to pass in a scrapelib.Scraper, it probably makes more sense to expose these things as spatula settings so that users can set up their spatula environment via environment variables or other means.
0.9.0 adds a prototype spatula.config that could become the means to do this.
Philosophy:
sane defaults most users won't want to mess with
easy to override in code/tests
support environment variables out of the box
abstract most/all scrapelib config from users
per-source overrrides for things like verify/timeouts/retries
While it is possible to pass in a scrapelib.Scraper, it probably makes more sense to expose these things as spatula settings so that users can set up their spatula environment via environment variables or other means.
0.9.0 adds a prototype spatula.config that could become the means to do this.
Philosophy: