wummel / linkchecker

check links in web documents or full websites
http://wummel.github.io/linkchecker/
GNU General Public License v2.0
1.42k stars 234 forks source link

No support for Brotli Compression? #672

Open JensKirk opened 8 years ago

JensKirk commented 8 years ago

Hi :-)

The linkchecker is not supporting the new Brotli Compression from Google and therefor no sites running Brotli compression (using SSL) is working.

You can test this on: https://www.qliving.com

Google Chrome and other browsers support Brotli Compression to speed up the loading of a site but LinkChecker does not.

peterjacobs commented 7 years ago

This would only be a problem if Brotli was the only compression supported by the webserver I think.

But that website also accepts gzip compression: curl -sH 'Accept-encoding: gzip' https://www.qliving.com | gunzip - and no compression: curl -sH 'Accept-encoding: ' https://www.qliving.com

I am not sure which "Accept-encoding" header linkchecker uses, but it seems to work fine with https://www.qliving.com

dpalic commented 6 years ago

Thank you for the issue report. Sadly this project is dead, and a new team is around with https://github.com/linkcheck/linkchecker for more details please see: #708 Also please close this issue and report it freshly on the new repo https://github.com/linkcheck/linkchecker/issues