A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
MIT License
800
stars
109
forks
source link
Figure out why specs are failing only on JRuby? #74
https://github.com/postmodern/spidr/runs/1460116982
Getting some spec failures only on JRuby.