How to implement the decision maker function

[kunal0810]

I am working on project where before crawling a page i need to check whether should a crawl this page or not. i have tried using the shouldcrawlpagedecisionmaker and does not get the right way to implement that.

can someone please help to get it correct. Displaying image.png

[sjdirect]

Apologies, the doc snippet was using a no longer supported method. Switch it to a property instead as the example below. I also updated the readme doc.

crawler.ShouldCrawlPageDecisionMaker = (pageToCrawl, crawlContext) => 
{
    var decision = new CrawlDecision{ Allow = true };
    if(pageToCrawl.Uri.Authority == "google.com")
        return new CrawlDecision{ Allow = false, Reason = "Dont want to crawl google pages" };

    return decision;
};