issues
search
bopoda
/
robots-txt-parser
PHP class for parse all directives from robots.txt files according to specifications
http://robots.jeka.by
MIT License
44
stars
17
forks
source link
RobotsTxtParser significantly improve performance (~1000x)
#39
Closed
bopoda
closed
7 years ago
bopoda
commented
7 years ago
resolve #20.
resolve #20.