search

scrapy / protego

A pure-Python robots.txt parser with support for modern conventions.
BSD 3-Clause "New" or "Revised" License
54 stars 28 forks source link

Correct a typo in protego.py #11

Closed felixonmars closed 3 years ago

Gallaecio commented 3 years ago

Thanks! Test errors are definitely unrelated.