search

overcast07 / wayback-machine-spn-scripts

Bash scripts which interact with Internet Archive Wayback Machine's Save Page Now
MIT License
101 stars 9 forks source link

You need to be logged in to use Save Page Now. error message #27

Open barkoder opened 1 year ago

barkoder commented 1 year ago

Despite me having specified my auths and despite me having manually checked I haven't been accidentally banned, I still get "You need to be logged in to use Save Page Now." message sometimes.

It's very odd.

Some captures on the list get saved successfully and some others give that error and fail immediately.

Could you make it such that if that error is generated, the script checks if -a is specified, and if so, then the script retries the capture instead?

Thanks!

overcast07 commented 1 year ago

The reason that this has been happening is that someone has been using AWS to overload the Internet Archive's servers with tens of thousands of requests per second. Normally this error message is exceptionally rare so I didn't think to account for it.