Add IsDecisionPermanent property to CrawlDecision

[GoogleCodeExporter]

Add IsDecisionPermanent property to CrawlDecision so the crawler knows when the 
Should....() methods will always return Allow = false from that point going 
forward.

An example is ShouldCrawl() which checks to make sure the MaxPagesToCrawl limit 
has not been reached. If it has been reached, it will always return false so 
then by setting IsDecisionPermanent = true the crawler knows there is no need 
to call this method since it will always be false.

Original issue reported on code.google.com by sjdir...@gmail.com on 17 Jan 2013 at 4:07

[GoogleCodeExporter]

Will not fix. This feature wouldn't be much help since all currently running 
threads would still have to finish processing. So adding this will not give a 
clean stop. Actually it slows down the crawl because I have to put a sleep in 
there to before stopping the crawl due to this new field to be sure all running 
threads are disposed properly.

Original comment by sjdir...@gmail.com on 1 Feb 2013 at 7:51

• Changed state: WontFix