Added property to ScrapingBrowser to skip certificate validation

rflechner / ScrapySharp

reborn of https://bitbucket.org/rflechner/scrapysharp

MIT License

346 stars 75 forks source link

Added property to ScrapingBrowser to skip certificate validation #31

Open mk1024 opened 3 years ago

mk1024 commented 3 years ago

ScrapingBrowser throws an exception if there is a problem with the server certificate. This exception prevents you from downloading the actual page and its content. I thought it might be useful to make this behavior configurable.

This fix allows to skip the server certificate validation and to download pages from domains with invalid certificates.