andreburgaud / robotspy

Alternative robots parser module for Python
https://pypi.org/project/robotspy/
MIT License
16 stars 1 forks source link