aivarsk / scrapy-proxies

Random proxy middleware for Scrapy
MIT License
1.66k stars 409 forks source link

https proxy issue #37

Open Brotakuu opened 6 years ago

Brotakuu commented 6 years ago

I have an issue where proxies are not being used when accessing https:// websites (uses my actual ip).

I've verified that my proxies do support https:// (by setting the env variable set HTTPS_PROXY=proxy address works).

Setting proxies in my proxy_list to http:// and https:// does not make a difference.