get-set-fetch / scraper

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
MIT License
107 stars 16 forks source link

support custom exporters #45

Closed a1sabau closed 3 years ago

a1sabau commented 3 years ago

Make it easier to define custom exporters by extending the base Exporter class. Existing exports, CsvExporter and ZipExporter, duplicate the resource parsing logic. Extract common code into parent class.