search

samclarke / robots-parser

NodeJS robots.txt parser with support for wildcard (*) matching.
MIT License
148 stars 19 forks source link

Patch for colon at the end or beginning of a line #6

Closed ghost closed 7 years ago

ghost commented 8 years ago

Will throw an error otherwise.