mirror for docker images

[ivmaks]

docker hub has pull limits https://www.docker.com/increase-rate-limits Please create docker image mirrors on alternative sites. For example https://quay.io/ thank

[ivmaks]

or https://github.com/features/packages

[alvaroaleman]

Any chance this will happen anytime soon?

[jszwedko]

~It seems like it'd be pretty easy for us to mirror to Github's registry, https://ghcr.io. Would that work for you @alvaroaleman @ivmaks ?~ Actually scratch that, I'm not sure we could use that registry. I'll dig around a bit more.

[jszwedko]

I think we could publish to gcr.io and/or public.ecr.aws.

[alvaroaleman]

Any registry that allows unauthenticated pulls without ratelimiting would work

[ykizin]

Hello! Any progress?

[jszwedko]

Hi @ykizin ! Not yet, but it is on our radar.

[mbastawisy]

Any news on when this can be available?

[spencergilbert]

I expect this issue to be closed by https://github.com/vectordotdev/vector/issues/10969 - which is currently on our roadmap to start 4/4/2022

[onedr0p]

Any update on this? Dockerhub really isn't OSS friendly anymore. They are pushing to enterprise and paid customers.

GHCR seems like an easy win.

[spencergilbert]

Hey @onedr0p - unfortunately it hasn't been a high priority for us recently. The likely plan is to co-opt Datadog's existing infrastructure here and publish to gcr.io/datadoghq, docker.io/datadog, public.ecr.aws/datadog - but we've ended up needing to shift other work in place of that.

That's on our list again this quarter - hopefully community need can help us keep it on the TODO list. cc @jszwedko for visibility.

[aquarhead]

Since you asked... I might as well add another +1 comment.

Publishing it to public.ecr.aws would be much appreciated as that's our main cloud provider and all Vector usage are in there for us currently. 🙏

[onedr0p]

It would be great to bump the priority on this, no one wants to have their observability into logs stopped because of dockerhubs silly rate limits. I'm still astonished that Grafana only pushes all their project images to dockerhub as well 😂

I digress but look forward to not having to rely on dockerhub someday <3

[jalaziz]

Hey @onedr0p - unfortunately it hasn't been a high priority for us recently. The likely plan is to co-opt Datadog's existing infrastructure here and publish to gcr.io/datadoghq, docker.io/datadog, public.ecr.aws/datadog - but we've ended up needing to shift other work in place of that.

That's on our list again this quarter - hopefully community need can help us keep it on the TODO list. cc @jszwedko for visibility.

I assume it didn't ship last quarter? Is it on the list for this quarter? We're running into this as well :(

[aquarhead]

Given the recent dockerhub announcement of removing free team orgs, I'm wondering if the current timberio org will be affected? And if so perhaps this could finally have a high priority?

[onedr0p]

Ref: https://github.com/docker/hub-feedback/issues/2314

[jszwedko]

We are using a paid dockerhub account and so won't be affected by this change. We do still aim to publish to other registries in the future though.

[dm3ch]

Is there any ETA? Having docker hub as a image source for daemonset is pretty painful nowdays due to their limits

[onedr0p]

I wonder with the effort in the latest release to move linux packages to another registry if could this also be prioritized now?

[applike-ss]

This (rather simple to fix) issue is now open for more than 3 years. I want to add my +1 onto this.