bejean / crawl-anywhere

Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration.
www.crawl-anywhere.com
Apache License 2.0
96 stars 38 forks source link

Check "Less no of pages are crawled" #60

Open bejean opened 10 years ago

bejean commented 10 years ago

https://groups.google.com/forum/#!topic/crawl-anywhere/B6CNSiWYCzw