search

ekalinin / robots.js

Parser for robots.txt for node.js
MIT License
66 stars 21 forks source link

check rules exists first #27

Closed skysteve closed 7 years ago

skysteve commented 7 years ago

Bug fix my own https://github.com/ekalinin/robots.js/pull/26 PR 😉

ekalinin commented 7 years ago

Thanks!