google / robotstxt

The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
Apache License 2.0
3.39k stars 232 forks source link

[redacted] #38

Closed alfodei22 closed 3 years ago