search

Garden-AI / garden

https://garden-ai.readthedocs.io
MIT License
19 stars 4 forks source link

Migrate DLHub containers to Garden DockerHub account #407

Closed WillEngler closed 7 months ago

WillEngler commented 7 months ago

We are currently migrating DLHub models to Garden. One challenge is that DLHub containers are in a private ECR repo in Ryan's AWS account. There is a credential stored on the demo endpoint K8s cluster that can be used to access the repo. It expires after 24 hours. There is a daemon running on the demo endpoint that refreshes the credentials.

It would be good to get the containers we need off of Ryan's account. Then we won't have to worry about the credential refresh process on the existing endpoint or future endpoints.

This will probably involve:

  1. Identifying the containers we need
  2. Pushing them to the Garden DLHub account
  3. Re-registering the old DLHub GLobus Compute functions with the new locations of the containers

Assumptions:

1. 4.

Acceptance Criteria

Given..., when..., then...

WillEngler commented 7 months ago

Copied all the containers to the Garden DockerHub account. Tracking the containers here: https://docs.google.com/spreadsheets/d/1AscO_tccfZLMyaLO3YJKdenDmDSO9vDObFcGMP1V2pY/edit#gid=0

Also figured out how to re-register an existing DLHub function with the new container location. Got one working as a proof of concept: https://colab.research.google.com/drive/1rrizhQSO7XIDp9kLIit6aB7jgO3IQbhe?usp=sharing