evilpie / 404-bookmarks

Firefox extension to find and remove expired bookmarks.
https://addons.mozilla.org/en-US/firefox/addon/404-bookmarks/
Mozilla Public License 2.0
17 stars 4 forks source link

The "429" Errors are actually being caused by this Add-On #16

Open AlanLesmerises opened 3 years ago

AlanLesmerises commented 3 years ago

As can easily be found from a Google search, an "HTTP Error 429 is an HTTP response status code that indicates the client application has surpassed its rate limit, or number of requests they can send in a given period of time" (from https://blog.hubspot.com/website/http-error-429). In other words, these errors are being triggered by the large number of rapid-fire HTTP requests that are used to verify the validity of bookmarked links. Furthermore, certain sites appear to be much more sensitive to this issue than others, such as Google and the family of Stack Exchange websites. If there were a way to moderate the rapidity of the HTTP requests to not trigger the 429 errors, or having a way to tell the Add-On to ignore those errors, the output would include far fewer questionable links and wouldn't send users on a wild goose chase trying to figure out why otherwise valid links are generating errors.

evilpie commented 3 years ago

Thanks for the report. Sometimes it's not obvious which domains are related, which would mean we would have to wait between every lookup. This would slow everything down.

Please don't expect a quick resolution here, I am not actively working on this extension.