Integrate proxyscrape.com - Githubissues

JaredLGillespie / proxyscrape

Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).

MIT License

244 stars 55 forks source link

Integrate proxyscrape.com #3

Closed JaredLGillespie closed 5 years ago

JaredLGillespie commented 5 years ago

Add support for https://proxyscrape.com/ proxies.

Add functions for the following new resource types:

proxy-scrape-http -> https://proxyscrape.com/proxies/HTTP_Working_Proxies.txt
proxy-scrape-socks4 -> https://proxyscrape.com/proxies/Socks4_Working_Proxies.txt
proxy-scrape-socks5 -> https://proxyscrape.com/proxies/Socks5_Working_Proxies.txt
proxy-scrape-transparent -> https://proxyscrape.com/proxies/HTTP_Transparent_Proxies.txt
proxy-scrape-anonymous -> https://proxyscrape.com/proxies/HTTP_Anonymous_Proxies.txt
proxy-scrape-elite -> https://proxyscrape.com/proxies/HTTP_Elite_Proxies.txt
proxy-scrape-http-10s-timeout -> https://proxyscrape.com/proxies/HTTP_10000ms_Timeout_Proxies.txt
proxy-scrape-http-5s-timeout -> https://proxyscrape.com/proxies/HTTP_5000ms_Timeout_Proxies.txt
proxy-scrape-http-2s-timeout -> https://proxyscrape.com/proxies/HTTP_2000ms_Timeout_Proxies.txt
proxy-scrape-socks5-10s-timeout -> https://proxyscrape.com/proxies/Socks5_10000ms_Timeout_Proxies.txt
proxy-scrape-socks5-5s-timeout -> https://proxyscrape.com/proxies/Socks5_5000ms_Timeout_Proxies.txt
proxy-scrape-socks5-2s-timeout -> https://proxyscrape.com/proxies/Socks5_2000ms_Timeout_Proxies.txt
proxy-scrape-socks4-10s-timeout -> https://proxyscrape.com/proxies/Socks4_10000ms_Timeout_Proxies.txt
proxy-scrape-socks4-5s-timeout -> https://proxyscrape.com/proxies/Socks4_5000ms_Timeout_Proxies.txt
proxy-scrape-socks4-2s-timeout -> https://proxyscrape.com/proxies/Socks4_2000ms_Timeout_Proxies.txt
proxy-scrape-ssl-10s-timeout -> https://proxyscrape.com/proxies/HTTP_SSL_Proxies_10000ms_Timeout_Proxies.txt
proxy-scrape-ssl-5s-timeout -> https://proxyscrape.com/proxies/HTTP_SSL_Proxies_5000ms_Timeout_Proxies.txt
proxy-scrape-ssl-2s-timeout -> https://proxyscrape.com/proxies/HTTP_SSL_Proxies_2000ms_Timeout_Proxies.txt
proxy-scrape-socks4-google-passed-10s-timeout -> https://proxyscrape.com/proxies/Socks4_Google_Passed_10000ms_Proxies.txt
proxy-scrape-socks4-google-passed-5s-timeout -> https://proxyscrape.com/proxies/Socks4_Google_Passed_5000ms_Proxies.txt
proxy-scrape-socks4-google-passed-2s-timeout -> https://proxyscrape.com/proxies/Socks4_Google_Passed_2000ms_Proxies.txt

JaredLGillespie commented 5 years ago

Recommend using the new API: https://proxyscrape.com/en/api

Will need to weight the options of either addign additional parameter information to allow flexible API calling versus having pre-defined set of resource-types.