issues
search
bopoda
/
robots-txt-parser
PHP class for parse all directives from robots.txt files according to specifications
http://robots.jeka.by
MIT License
44
stars
17
forks
source link
Handle list of user-agents
#47
Closed
bopoda
closed
7 years ago
bopoda
commented
7 years ago
ref #27
ref #27