Update README.md (Solve #42)

bopoda / robots-txt-parser

PHP class for parse all directives from robots.txt files according to specifications

http://robots.jeka.by

MIT License

44 stars 17 forks source link

Closed kennylajara closed 7 years ago

kennylajara commented 7 years ago

1) Translated to english (with the help of Google Translator). 2) Minor changes in format. 3) Added example of use for the RobotTxtValidator class

bopoda commented 7 years ago

Merged, thanks!