Check not possible when behind Nginx?

andersju / webbkoll

An online tool that checks how a website is doing with regards to privacy

MIT License

266 stars 28 forks source link

Check not possible when behind Nginx? #7

Closed ridoo closed 5 years ago

ridoo commented 6 years ago

The tool fails checking a Website when sending invalid data chunks. Nginx logs the following:

51.15.235.198 - - [23/May/2018:10:11:57 +0000] "-" 400 0 "-" "-"
51.15.235.198 - - [23/May/2018:10:11:57 +0000] "-" 400 0 "-" "-"
51.15.235.198 - - [23/May/2018:10:11:57 +0000] "-" 400 0 "-" "-"

After 3 or 5 seconds the Tool says

Error: Failed to fetch this URL.

Try again?

andersju commented 6 years ago

Can you provide the URL of a website where this happens, so I can test? (You can email anders@unix.se if you don't want to do it here)

andersju commented 5 years ago

We've now switched from PhantomJS (which had all kinds of issues) to Puppeteer (running a recent version of Chromium), which appears to have fixed this issue.