search

akamhy / waybackpy

Wayback Machine API interface & a command-line tool
https://pypi.org/project/waybackpy/
MIT License
452 stars 32 forks source link

Save Page limitations. How many URLs can be saved per minute? #187

Open ccashmore opened 1 year ago

ccashmore commented 1 year ago

Error returns 'Save Page Now limits saving 15 URLs per minutes. Try waiting for 5 minutes and then try again.' but does not specify how many minutes 15 URLs can be saved in. Any answers to this?

David-Lor commented 1 year ago

Theorically, the limit is 15 URLs per minute, and whenever this limit is exceeded, the IP gets blocked for 5 minutes.

Source: https://archive.org/details/toomanyrequests_20191110

overcast07 commented 7 months ago

The limit can be changed by IA. Since the most recent change about half a year ago, the limit has been 6 URL submissions per minute for logged-in users and 3 URL submissions per minute for logged-out users. Exceeding this limit does not in and of itself cause an IP block.

The IP throttling is a separate limit which is probably based on the overall number of web requests (which is not necessarily the same as the number of submitted URLs), but I don't know what that limit is.