aws / deep-learning-containers

AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.
https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Other
954 stars 445 forks source link

[feature-request] For Neuron Container to be released in eu-west-2 (London Region) #3981

Open mccartni-aws opened 3 weeks ago

mccartni-aws commented 3 weeks ago

Checklist

Concise Description: I am working with a customer who urgently needs a Neuron Container (for inference with inf2 instances) in the eu-west-2 region. As per the Available DLC Images site, there are no Neuron containers available in the eu-west-2 region.

DLC image/dockerfile: 763104351884.dkr.ecr.eu-west-1.amazonaws.com/huggingface-pytorch-tgi-inference:2.1.2-optimum0.0.22-neuronx-py310-ubuntu22.04 This is the eu-west-1 region version of the image, but we would like it in the eu-west-2 region.

Is your feature request related to a problem? Please describe. It's frustrating that this container hasn't been released within the eu-west-2 region.

Describe the solution you'd like We would like a Neuron container to be made available in the eu-west-2 region, in the same region that we're working in in the customer's account. repository-name = huggingface-pytorch-tgi-inference image-tag = 2.1.2-optimum0.0.22-neuronx-py310-ubuntu22.04

Describe alternatives you've considered

  1. Pull image from public ECR in the eu-west-1 region and then push to our private ECR repo in the eu-west-2 region.
  2. We start working in the eu-west-1 region for this use-case. Not really an option for the customer.
  3. We use Docker to pull from public ECR and then push our private Dockerhub. Not ideal for the customer.

Additional context Add any other context or screenshots about the feature request here.

Screenshot 2024-06-03 at 09 58 44