search

ekalinin / robots.js

Parser for robots.txt for node.js
MIT License
66 stars 21 forks source link

setUrl() is blocked #23

Open fprivitera opened 8 years ago

fprivitera commented 8 years ago

if you try to get sitemaps of : http://autoclubsouth.aaa.com/robots.txt

it will never call the after_parse callback