Handle noindex directive

bopoda / robots-txt-parser

PHP class for parse all directives from robots.txt files according to specifications

http://robots.jeka.by

MIT License

44 stars 17 forks source link

Closed LeMoussel closed 7 years ago

LeMoussel commented 7 years ago

Resolve Issue #26

bopoda commented 7 years ago

Thanks for PR! looks good, but could you please to fix a few comments above? It should be merged when travis build will be ok.

bopoda commented 7 years ago

Tests passed. Thanks!