stewartmckee / cobweb

Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
MIT License
227 stars 45 forks source link

Tidy up README #42

Closed maxehmookau closed 8 years ago

maxehmookau commented 8 years ago

Nothing too exciting here. Just tidying up the README so it's easier to read.

Thanks for this gem, it's been really useful!

stewartmckee commented 8 years ago

Cheers...