need to add logic to slow down crawl on HTTP 429 errors

PageModifiedOfficial / Check-My-Links

A Google Chrome extension which allows you to check webpages for broken links (Response Code 404 etc)

MIT License

185 stars 86 forks source link

Open JgrPPC opened 1 year ago

JgrPPC commented 1 year ago

There needs to be logic to add delay when encountering a 429 error (caused by rate-limiting security software).

JgrPPC commented 1 year ago

It appears that version 3.8.2.1020 (pull 108) addresses this issue. The version available in the chrome web store is 3.8.2 last updated 11/19/2020.

Can someone push the updated version to the chrome web store?

richardscottclark commented 2 months ago

This is still an issue for us, we have cache valid links on. Rate limiting would be amazing.