issues
search
scrapy
/
protego
A pure-Python robots.txt parser with support for modern conventions.
BSD 3-Clause "New" or "Revised" License
54
stars
28
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[GSoC 2019] Developing Protego :)
#1
anubhavp28
closed
5 years ago
9
Previous