Closed VascoRatoFCCN closed 2 years ago
https://github.com/arquivo/arquivo-webapp-eros/commit/8e73a64e7ca460a2ae4601834093d2b675751a40 changes the checking behavior. Instead of blocking the request, it lets it go through and logs the error. e.g.:
This is good because we are no longer blocking users from using our service.
However, we now are susceptible to getting some cryptic messages while trying to use SavePageNow:
This SO answer has a solution to the CA certificate problem. We should analyze the logs to see if we should back to the previous implementation using this fix.
A related problem, SavePageNow can be used to bypass security verification, it works on many of https://badssl.com/ examples of bad SSL. How the browser reacts: How SavePageNow reacts:
Fixed
When trying to record some websites like www.essv.ipv.pt or stayawaycovid.pt we get the following response:
However, web browsers have no problem accessing these websites:
It happens because the CA certificate is missing some information that most web browsers can easily fill in. SavePageNow before starting to record a webpage, it tries to do a http request to the requested website. If anything goes wrong it doesn't start recording, in this case we get an error due to a misconfigured CA certificate.