A browser extension that can be installed by volunteers to participate in mwmbl distributed crawling.
GNU Affero General Public License v3.0
21
stars
2
forks
source link
Check the number of unique domains to prevent falling into loops #13
Closed
daoudclarke closed 2 years ago