search

jculvey / roboto

A web crawler/scraper/spider for nodejs
66 stars 24 forks source link

Add path for the item issue and obeyNofollow option #3

Closed f1ames closed 10 years ago

f1ames commented 10 years ago

Hello, I solved "Add path for the item #1" issue and added obeyNofollow option.

jculvey commented 10 years ago

This is great! Thanks for the contribution.