search

matthewmueller / x-ray

The next web scraper. See through the <html> noise.
MIT License
5.87k stars 349 forks source link

add a 'catch' method? #281

Closed FezVrasta closed 5 years ago

FezVrasta commented 6 years ago

It happens sometimes that the crawler fails for whatever reason, it would be super useful to have a .catch method that can be used to recover the scraped data until the moment of the crash so that the data is not lost.

lathropd commented 5 years ago

This is a good idea. Merging into #315 since that encompasses native promises.