Closed GoogleCodeExporter closed 9 years ago
Pros:
-Allows users to determine crawl behavior on the fly
-No classes or interfaces to implement and plugin
Cons:
-Not easy to test compound crawl behaviors
-Users must set these values on every instance (lots of copy and paste)
-Hard to group related or behaviors that are grouped together
Original comment by sjdir...@gmail.com
on 31 Dec 2012 at 3:56
Issue 24 has been merged into this issue.
Original comment by sjdir...@gmail.com
on 31 Dec 2012 at 3:56
Original comment by sjdir...@gmail.com
on 31 Dec 2012 at 6:13
Added ShouldCrawlPage(), ShouldCrawlPageLinks() and ShouldDownloadPageContent()
Original comment by sjdir...@gmail.com
on 2 Jan 2013 at 6:59
Original issue reported on code.google.com by
sjdir...@gmail.com
on 7 Nov 2012 at 5:19