search

sic2 / favara

A simple and easy to use crawler for web sources (fb, twitter, nodebb, etc)
MIT License
1 stars 0 forks source link

The crawler should skip failing sources and proceed with the others #3

Open vigliag opened 7 years ago

vigliag commented 7 years ago

This will be particularly important when we have multiple crawlers, as we don't want a failing one to stop all the crawling.