Closed zolrath closed 1 year ago
Closes #51, currently doesn't restrict blacklist to the domain to allow certain terms to prevent crawling.
Closes #51, currently doesn't restrict blacklist to the domain to allow certain terms to prevent crawling.