eklem / browsercrawler

Crawling content from a site within the browser. A basis for i.e. a search solution for static sites.
https://eklem.github.io/browsercrawler/doc/
MIT License
2 stars 0 forks source link

Update index #47

Closed eklem closed 5 years ago

eklem commented 6 years ago

This will end up in search-index-housekeeper. Store when page has been updated. When user enters page again, check if update in search-index-housekeeper matches. If not, crawl page, and do the same to all URLs found on that page.