Make `time.sleep` configurable and default to zero

DocNow / diffengine

track changes to the news, where news is anything with an RSS feed

MIT License

178 stars 30 forks source link

Make `time.sleep` configurable and default to zero #76

Closed nahuelhds closed 4 years ago

nahuelhds commented 4 years ago

When asked for it use at #74 , @edsu said:

I put it there to prevent getting blocked by websites that saw repeated and rapid crawling as a threat. But honestly I had kind of forgotten about it. It might be nice to retain it as a configuration option, and have it default to zero?