internetarchive / liveweb

Liveweb proxy of the Wayback Machine project
https://web.archive.org/
44 stars 13 forks source link

liveweb proxy does not appear to proxy and record https #44

Open samuel-archive opened 11 years ago

samuel-archive commented 11 years ago

looks like the liveweb proxy does not handle https, for example:

$ curl --progress-bar -v -x wwwb-live0:9090 https://archive.org/ | zcat | wc

returns a 500 error

ikreymer commented 11 years ago

To actually proxy https over http is rather complicated and unnecessary for this use case (just looked into it for wayback itself acting as proxy server). I would suggest something like this:

curl -H "x-archive-proxy-protocol: https" -x wwwb-live0:9090 http://archive.org/

and use the custom header to let the proxy know it should grab that content via https rather than http.