search

apify / proxy-chain

Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.
https://www.npmjs.com/package/proxy-chain
Apache License 2.0
852 stars 146 forks source link

How to proxy HTTPS? #537

Closed TheGP closed 5 months ago

TheGP commented 5 months ago

While opening website in a browser (connected to proxy-chain) looks like connect requests skip prepareRequestFunction completely and not redirected to proxy, why? I want to proxy everything.

jancurn commented 5 months ago

HTTPS is proxied using so-called HTTP CONNECT tunnel and the prepareRequestFunction function is called once when this tunnel opens. The problem is that web browser typically reuse HTTPS connections to the website for multiple requests, which is transparent to the proxy due to encryption, so the prepareRequestFunction is not called again. You'll need to restart the browser or force it somehow not to reuse HTTPS connections.

jancurn commented 5 months ago

I wrote it. The problem is the browser, it just opens one socket for multiple requests. To control the requests, you need to make the browser open new sockets for each request. There's nothing the proxy can do about it.

TheGP commented 5 months ago

@jancurn my apologies I re-read it and removed before you answered. How does normal HTTP proxy work then correctly? So proxy-chain should keep connections open then.

jancurn commented 5 months ago

Proxy just proxies sockets, but has not idea what data is running in them. That's what the web browser and the web server control.

TheGP commented 5 months ago

Yes thats what I want.