search

eklem / browsercrawler

Crawling content from a site within the browser. A basis for i.e. a search solution for static sites.
https://eklem.github.io/browsercrawler/doc/
MIT License
2 stars 0 forks source link

Take an array of url's and crawl #13

Open eklem opened 6 years ago

eklem commented 6 years ago

Make the crawler take an array of URLs as input. The output should be the array items.

eklem commented 6 years ago

The URL array can be defined in setup.json together with an array of selector rules. Should be fetched with the fetch API, then no browserifying is needed.

eklem commented 6 years ago

How to loop through the array: https://stackoverflow.com/questions/31710768/how-can-i-fetch-an-array-of-urls-with-promise-all