search

versioneye / crawl_r

VersionEye crawlers implemented in Ruby.
https://www.versioneye.com
Other
10 stars 7 forks source link

Split `CpanCrawler.crawl` into Producer and Worker #64

Closed timgluz closed 7 years ago

timgluz commented 7 years ago

It would be simpler and more robust to use persistent MQs when paginating over releases.

timgluz commented 7 years ago

Ready for review

reiz commented 7 years ago

This should be done now.