search

benbalter / sitemap-parser

Ruby Gem to parse sitemaps.org compliant sitemaps
MIT License
29 stars 46 forks source link

Handle 404s, timeouts, etc. #1

Closed benbalter closed 10 years ago

benbalter commented 10 years ago

Possibly via https://github.com/typhoeus/typhoeus.