aws / containers-roadmap

This is the public roadmap for AWS container services (ECS, ECR, Fargate, and EKS).
https://aws.amazon.com/about-aws/whats-new/containers/
Other
5.21k stars 319 forks source link

[ECR] [request]: PrivateLink - Integration with Amazon S3 *interface* endpoint #1691

Open mayk0gan opened 2 years ago

mayk0gan commented 2 years ago

Community Note

Tell us about your request As known, ECR requires also connectivity to s3, for pulling the docker images. If one creates a repository in us-east-1 for example, AWS will save the corresponding images in some bucket in the same region (us-east-1 in this example). The case becomes trickier when it comes to using ECR's PrivateLink endpoint (specifically - in cross region orchestration).

AWS posted while ago this article which somewhat appears as not found in the last few weeks. However, following this guide we can create cross-regional orchestrations which evolves many AWS services - even communicate with S3 bucket in another region using S3 VPC Interface (and not gateway).

The problem is that ECR works solely with S3 VPC Gateway and not interface, which doesn't allow cross-region communication (using VPC peering/ transit gateways). So my request is as follows: integrate ECR endpoint with optional S3 VPC endpoint (instead of in addition to vpc gateway), which would allow the case from above (and many more) - as it wouldn't be bounded to only intra-regional communication (as in most available services).

Which service(s) is this request for? ECR, PrivateLink, S3 Interface Endpoint

Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard? Described above. We run in every AWS region, and need to pull various docker containers (potentially 100+) in a daily basis. Without the requested integration - it would make us to replicate all of our docker containers (thousands), across all regions - which is costly, harder to maintain and personally - I believe that it's really unneeded - as it makes AWS ECR Endpoint much less powerful from what it could be. This would allow us to maintain a single registry in a single region, and pull images from multiple regions - which would simplify it as describe above.

Are you currently working around this issue? I tried to find a work around, but still didn't find one.

rpadovani commented 2 years ago

I subscribe this. The S3 gateway forces us to open our network ACLs to countless public IP addresses (and then update them, since they change and there is no native way to keep the ACLs up to date).

With an interface, I can have very strict networks ACL to be sure our traffic doesn't leave the VPC.

hachemguetif commented 4 months ago

S3 interface supports private DNS with AWS PrivateLink [1].

[1] https://aws.amazon.com/blogs/storage/introducing-private-dns-support-for-amazon-s3-with-aws-privatelink/