search

pgaref / HTTP_Request_Randomizer

Proxying Python Requests
http://pgaref.com/blog/python-proxy/
MIT License
148 stars 60 forks source link

Added a way to filter proxies by protocol + fixed PremProxy provider #46

Closed la55u closed 6 years ago

la55u commented 6 years ago

Proxies can now be filtered with an optional parameter in the RequestProxy constructor. For this the parsers have to set the supported protocols for each proxy object they build. Protocols are stored in the ProxyObject.Protocol enum. Currently only FreeProxy parser supports HTTPS, but i'll add sslproxies dot org later as well. PremProxy: parsing was broken because the port number was 'encrypted' and no longer stored in CSS. They are now obtained from a javascript file that holds a function to the key-port pairs.

Let me know if I missed anything or something is wrong.

pgaref commented 6 years ago

Thanks for the PR @la55u ! I can take a look in a few hours. Could you please fix the failing test cases? I believe they are related with the renamed provider class (PremProxyParser)

pgaref commented 6 years ago

Thanks for the PR @la55u ! The changes were merged to the master after some polishing and fixing the failing test case. You can check the updated PR at #47 which also added you to the contributors list :)

It would be great to have the protocol filter you introduced as part of the command line arguments as well in the future! Marked as #48

Thanks again for contributing!

la55u commented 6 years ago

Cool, thanks for the fixes I was really lost with these tests...