search

Ge0rg3 / requests-ip-rotator

A Python library to utilize AWS API Gateway's large IP pool as a proxy to generate pseudo-infinite IPs for web scraping and brute forcing.
https://pypi.org/project/requests-ip-rotator/
GNU General Public License v3.0
1.36k stars 140 forks source link

AWS Costs #59

Closed rexovas closed 1 year ago

rexovas commented 1 year ago

Excellent package here, a true lifesaver.

Not really a library issue, but based on the README, I was expecting costs to be little or nothing, however - it seems that I've managed to rack up $40.00 of API Gateway costs this month alone. I'm really not sure how this can be, I would expect my number of requests to be < 1,000,000.

Not a big deal, but was a bit surprised. Any ideas why the costs are so high?

Ge0rg3 commented 1 year ago

Hi @rexovas! When you were using the library, did you stick to one region only or did you spread across many? If you spread across, then you get the benefit of using the free tier in each separate region, otherwise you'll quickly use it up in just one.

rexovas commented 1 year ago

I spread across many, in fact - half of the costs are associated with “Other” regions

0D14F41A-7D63-48D3-A646-245136CA4FA9 43C34891-0B75-48AF-9055-DE77FAD95B82

Maybe my account is not eligible for the free tier any longer? There is no way I would have previously used regions other than the us-east and maybe the us-west regions previously for any AWS service.

Ge0rg3 commented 1 year ago

Strange.. Please can you check your free tier status on the Billing Console->Free Tier page?

If your account is more than a year old I don't think it'll be valid still.

rexovas commented 1 year ago

Ah yep, this account is maybe 5-6 years old

Screenshot 2023-05-11 at 6 49 08 PM

Maybe time to make a new one 😉

Ge0rg3 commented 1 year ago

Ahh yep that would be it.. I should probably clarify the higher costs in the README 😊