search

buren / wayback_archiver

Ruby gem to send URLs to Wayback Machine
https://rubygems.org/gems/wayback_archiver
MIT License
57 stars 11 forks source link

Crawler #2

Closed buren closed 9 years ago

buren commented 9 years ago

Crawl site until no new links are found.