Closed chrisv2 closed 9 years ago
patch which adds a '--exclude' option, consisting of comma-separated list of patterns to exclude from crawl. excluding stuff like ^/admin can significantly speed up the crawl.
Closing this, but feel free to resend it with an updated patch. Sorry this took so long for me to get back to :(
patch which adds a '--exclude' option, consisting of comma-separated list of patterns to exclude from crawl. excluding stuff like ^/admin can significantly speed up the crawl.