search

andykais / scrape-pages

generalized scraper using a single instruction set for any site that can be statically scraped
https://scrape-pages.js.org
MIT License
6 stars 2 forks source link

command line interface #66

Open andykais opened 3 years ago

andykais commented 3 years ago

collect data:

scraps --instructions nasa-iotd.txt --folder ./downloads --options options.json

query data:


echo '{"labels": ["images"]}' | scraps --folder ./downloads
# or
scraps --folder ./downloads ./query.json