search

rejoiceinhope / scrapy-proxy-pool

164 stars 33 forks source link

A lot of proxies failing #3

Open mapb1994 opened 4 years ago

mapb1994 commented 4 years ago

2019-10-26 13:42:37 [scrapy_proxy_pool.middlewares] DEBUG: Retrying <GET https://www.chemicalbook.com/ProductChemicalPropertiesCB2389240_EN.htm> with another proxy (failed 1 times, max retries: 5) 2019-10-26 13:42:37 [scrapy_proxy_pool.middlewares] DEBUG: [ProxyChoosen] http://45.76.6.67:8888 2019-10-26 13:42:39 [scrapy_proxy_pool.middlewares] DEBUG: Retrying <GET https://www.chemicalbook.com/ProductChemicalPropertiesCB21269725_EN.htm> with another proxy (failed 1 times, max retries: 5) 2019-10-26 13:42:39 [scrapy_proxy_pool.middlewares] DEBUG: [ProxyChoosen] http://66.65.11.229:10050 2019-10-26 13:42:41 [scrapy_proxy_pool.middlewares] DEBUG: Retrying <GET https://www.chemicalbook.com/ProductChemicalPropertiesCB42457396_EN.htm> with another proxy (failed 3 times, max retries: 5) 2019-10-26 13:42:41 [scrapy_proxy_pool.middlewares] DEBUG: [ProxyChoosen] http://209.212.33.99:8080 2019-10-26 13:42:43 [scrapy_proxy_pool.middlewares] DEBUG: Retrying <GET https://www.chemicalbook.com/ProductChemicalPropertiesCB91302478_EN.htm> with another proxy (failed 4 times, max retries: 5) 2019-10-26 13:42:43 [scrapy_proxy_pool.middlewares] DEBUG: [ProxyChoosen] http://18.224.73.128:3838 2019-10-26 13:42:43 [scrapy_proxy_pool.middlewares] DEBUG: Retrying <GET https://www.chemicalbook.com/ProductChemicalPropertiesCB11285175_EN.htm> with another proxy (failed 3 times, max retries: 5) 2019-10-26 13:42:43 [scrapy_proxy_pool.middlewares] DEBUG: [ProxyChoosen] http://98.126.156.186:3838 2019-10-26 13:42:45 [scrapy_proxy_pool.middlewares] DEBUG: Retrying <GET https://www.chemicalbook.com/ProductChemicalPropertiesCB11767709_EN.htm> with another proxy (failed 2 times, max retries: 5)

A lot of proxies are failing. Are the proxies dead? How could i update this list?

bpospanov commented 4 years ago

same stuff

T-travis commented 4 years ago

same

mrconstantino commented 4 years ago

The same problem. Has anyone found a solution? Could @hyan15 help us?