issues
search
andykais
/
scrape-pages
generalized scraper using a single instruction set for any site that can be statically scraped
https://scrape-pages.js.org
MIT License
6
stars
2
forks
source link
scrapeNext clause
#5
Closed
andykais
closed
5 years ago
andykais
commented
5 years ago
tasks:
[x] add recursive async feedback loop (
project-card
)
[x] add download priority (
project-card
)
[ ] store accurate scrapeNext index in db (using parentId works fine!)
[x] add functional tests (its about time the whole system gets tested) (
project card
)
tasks: