search

buren / wayback_archiver

Ruby gem to send URLs to Wayback Machine
https://rubygems.org/gems/wayback_archiver
MIT License
57 stars 11 forks source link

Make crawler threaded #3

Closed buren closed 9 years ago

buren commented 9 years ago

Also enable configurable timeout, so that the user can tweak how fast URLs are fetched/submitted.

buren commented 9 years ago

Out of scope for this gem now, since site_mapper ha been added