claffin / cloudproxy

Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
https://cloudproxy.io/
MIT License
1.4k stars 80 forks source link

Code refactor and deduplication #39

Closed claffin closed 1 year ago

claffin commented 3 years ago

There is significant code duplication across the providers, particularly in the main.py file where the logic for each provider has been mixed in for general application logic.

This, and other parts, could be refactored to deduplicate. It would have the additional benefit of making it easier to add additional providers in the future.