akamhy / waybackpy

Wayback Machine API interface & a command-line tool
https://pypi.org/project/waybackpy/
MIT License
453 stars 32 forks source link

Too Many Requests #97

Closed akamhy closed 2 years ago

akamhy commented 3 years ago

Too Many Requests We are limiting the number of URLs you can submit to be Archived to the Wayback Machine, using the Save Page Now features, to no more than 15 per minute.

If you submit more than that we will block Save Page Now requests from your IP number for 5 minutes.

Please feel free to write to us at info@archive.org if you have questions about this. Please include your IP address and any URLs in the email so we can provide you with better service.

Too Many Requests Screenshot from 2021-04-24 17-14-23

akamhy commented 2 years ago

Nothing to do here, closing.

rafaelrdealmeida commented 2 years ago

Hi @akamhy,

does waybackpy handle this (no more than 15 minutes per minute)? or is that the responsibility of the waybackpy user?

cheers

akamhy commented 2 years ago

@rafaelrdealmeida waybackpy has an inbuilt delay between the API calls to all of the three APIs. You would never hit the 15 archives per minute limit unless you are running multiple instances of waybackpy(by threading or parallel tasks) on the same IP address.