search

mojaloop / design-authority-project

This is the Issue and Decision Log for tracking mojaloop and related Designs
1 stars 2 forks source link

Docker Hub rate limiting PULL requests #76

Closed mdebarros closed 2 years ago

mdebarros commented 3 years ago

Request Summary:

The deployment of Mojaloop is severely impacted due to the recently imposed rate-limits on Docker-Hub Pull requests. The result being that deployment times have substantially increased.

Ref: https://www.docker.com/increase-rate-limits

Request Details:

Agreement on how this can be best resolved.

Current options:

  1. Setup a local Proxy Cache service that pulls Docker images on behalf of the client, and caches the images locally. The images will then be served subsequently from the local cache thereby avoiding Docker-hub Pull requests and thus avoid rate-limiting. This option requires extra infrastructure and services to be installed and managed by the Core-OSS team.
  2. Use a paid account (Docker Pro / Docker Team account) that provides unlimited Pull requests. This option requires the existing Docker org to be upgraded to a paid subscription, thereby removing the Pull request limits. In addition, there are some configurations changes required to Mojaloop Helm charts to support user authentication.

Artifacts:

Dependencies:

Accountability:

Decision(s):

- **Approved By:** ### Details - [ ] Actual decision made as a result of discussion ## **Follow-up**: - [ ] Actions to implement the decisions
godfreykutumela commented 3 years ago

Hi @mdebarros It looks like there is a cost associated with each of the two options proposed here so I recommend forwarding this as-is to Kim for guidance.

lewisdaly commented 3 years ago

@mdebarros yeah I've noticed this when deploying as well... it's a real pain.

With option #2, does that mean that users wishing to use our charts are still rate limited? My concern is newcomers to the community struggling to get up and running with our helm charts, and I think we need to consider that in any solution.

lewisdaly commented 3 years ago

This link has some helpful tips: https://blog.container-solutions.com/dealing-with-docker-hub-rate-limiting

bushjames commented 3 years ago

Presented and discussed at DA meeting 2021-01-20 13:00 UTC

mdebarros commented 3 years ago

Commit to v11.1.0 Helm release:

bushjames commented 3 years ago

@mdebarros has updated default image pull policy on helm charts. Will be released as part of v12.0.0 mojaloop. Monitor situation and revisit if issue persists.

elnyry-sam-k commented 3 years ago

helm v12.0.0 : https://github.com/mojaloop/helm/releases/tag/v12.0.0 released last week (Feb 15th)