search

google / robotstxt

The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
Apache License 2.0
3.39k stars 232 forks source link

Update README.md #16

Closed alanyee closed 5 years ago

alanyee commented 5 years ago

Make explicit HTTPS calls and update mac terminology