search

alephdata / memorious

Lightweight web scraping toolkit for documents and structured data.
https://docs.alephdata.org/developers/memorious
MIT License
311 stars 59 forks source link

Include mapping inside memorious crawler #60

Closed uhhhuh closed 3 years ago

uhhhuh commented 5 years ago

Provide an ability to run mapping from inside the scraper (in scraper YAML config) as a final step. https://github.com/alephdata/followthemoney/issues/41

sunu commented 3 years ago

We now run mappings after a crawler in Argo workflows. So this feature is no longer necessary.