benbalter / sitemap-parser

Ruby Gem to parse sitemaps.org compliant sitemaps
MIT License
29 stars 46 forks source link

Pass in opts for `followlocation` #6

Closed gjtorikian closed 10 years ago

gjtorikian commented 10 years ago

Sometimes you don't want to followlocation.

Suppose you're navigating a sitemap and you're fetching the content. URL A has a redirect to URL B. In that instance, fetching URL A and URL B yields the same information. But you don't necessarily give a hoot about URL A in this instance.

benbalter commented 10 years ago

Makes sense. Added you as a collaborator. Thanks for giving this little Gem some :heart:. Couldn't believe nothing existed.