akamhy / waybackpy

Wayback Machine API interface & a command-line tool
https://pypi.org/project/waybackpy/
MIT License
453 stars 32 forks source link

Use CDX API as a backup for availability API failures #85

Closed akamhy closed 2 years ago

akamhy commented 3 years ago

availability is not robust compared to CDX. We can use CDX as a reliable fallback.

akamhy commented 2 years ago

But what if the user passes the JSON flag?

akamhy commented 2 years ago

Closing, this.

It's always a bad idea to call another API without the end-user explicitly asking to do so.

Maybe better opinion is using a default retries for availability API requests.

akamhy commented 2 years ago

Just for future ref: The availability API now supports retries with time delays for better performance. See https://github.com/akamhy/waybackpy/commit/c0252edff284aa5fd9df063b17df8183cc7c9d65.