bopoda / robots-txt-parser

PHP class for parse all directives from robots.txt files according to specifications
http://robots.jeka.by
MIT License
44 stars 17 forks source link

need to have 2 methods (isUrlAllow, isUrlDisallow) to check is url allow or not #10

Closed bopoda closed 7 years ago

bopoda commented 7 years ago
public function isUrlAllow($url)
public function isUrlDisallow($url)
bopoda commented 7 years ago

merged https://github.com/bopoda/robots-txt-parser/pull/11