search

claffin / cloudproxy

Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
https://cloudproxy.io/
MIT License
1.4k stars 79 forks source link

AWS enchancements #26

Closed xanrag closed 3 years ago

xanrag commented 3 years ago

Using the Spot market for AWS would be nice, 60-70% cheaper. Looks pretty easy, just add some InstanceMarketOptions to the create_instances call.

Also, would be nice if the ami string was a setting since that ami doesn't exist on at least eu-west-1.

claffin commented 3 years ago

Thanks for the suggestion, I will add spot instance settings (as sometimes spot instances are not available) and will add a setting for the AMI in the next few days. I wasn't aware of the AMI names varied by region.