search

buildpacks / registry-api

API for searching and reading the Buildpack Registry
Apache License 2.0
3 stars 8 forks source link

Throttle indexer to avoid 429s from regsitry #93

Closed jkutner closed 2 years ago

jkutner commented 2 years ago

Prevent periodic errors like:

2022-09-02T15:15:07.583863+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='paketo-buildpacks/java-native-image@7.13.0' reason='GET https://gcr.io/v2/token?scope=repository%3Apaketo-buildpacks%2Fjava-native-image%3Apull&service=gcr.io: unexpected status code 429 Too Many Requests: Quota Exceeded.'
edmorley commented 1 year ago

I'm seeing quite a few rate limit errors still, eg:

2023-06-20T20:01:15.954609+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@1.0.0' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:d4ba73c28e183b52bbac6e892877d28328ae1a5f1abdf9d1db55afb90da23ce5: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.973622+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@0.2.3' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:d334bb25a535eb64c3ce92f0ec81a45bdaf59139667b01d79bc7b9852ad7a181: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.980508+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@0.2.5' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:a44e26cb65427da9734ddca81973a7809e732d8f3fe8b3cc5ad247d95df21a26: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.980509+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@1.0.1' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:e17eeb20348354547793da1dc85401a0556bda9129c476aa1f6c2216bab898a3: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.984081+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@0.2.2' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:0f16d1abcba8a1fcea3a77343e2e11f7902ec19121d1a672f067a8d100620f05: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.984853+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@1.0.5' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:9bf891728f37e4a6259b348bf24536764414f1fe6938ed526cd55e4c6e144cae: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.984922+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@0.2.1' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:7bff54457286a9a36dbcaec77ab041d61c2e1a47741d459c3457e429f6d2f268: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.985234+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@1.0.3' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:450ccbb49d5e81bda57ab32637cf9ba53fcd47a1b0af979ea8d090ed122f1cb1: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.986812+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@1.0.4' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:a4d8e60cf3047c04412081619a7c1c8146fa252115c93029a7ae34d699126fe7: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.987188+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@0.1.1' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:5935048d26f8a351679e2f1eeef3e890856ae8c6fac882284d3848cd87edff74: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.987643+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@0.2.4' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:de5997ef358f4b490df3b24386f00665c20c31aeab600856e144fdd62a4c50fb: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.987757+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@1.0.2' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:cb2e661526235d924872559322f6fa0105a4d3ae867b328891a5a7d607fb62ca: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.987955+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@0.2.6' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:af049ca047a071c4b23ffaad38d6398685fc635fab647754057bbfc3bc95c40b: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'
2023-06-20T20:01:15.990013+00:00 app[index.1]: at=handleMetadata level=warn msg='failed to fetch config' entry='heroku/maven@0.2.0' reason='GET https://index.docker.io/v2/heroku/buildpack-maven/manifests/sha256:e495f3562e5f1bb0c0ccc9e5b7c319c29ab95e4c2525c124800964981ada27f6: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit'