A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
MIT License
800
stars
109
forks
source link
Use Travis' new container-based infrastructure #54
Travis CI says it is faster than legacy structure. ref: https://docs.travis-ci.com/user/migrating-from-legacy/