search

stewartmckee / cobweb

Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
MIT License
227 stars 45 forks source link

bug fix on head -- was seeing errors on a redirect #4

Closed rojotek closed 12 years ago

rojotek commented 12 years ago

Made the redirect work better on head methods. head is getting closer and closer to get. ...ts and bringing it closer to the get method.

rojotek commented 12 years ago

there was also a typo in the gemspec -- breaking it, which has been fixed as well.