As mentioned in #1820, there is currently no way to authenticate with a private container image repo for Batch. In AWS, the ARN of a secret containing those credentials can be included in the job definition, which is what I've exposed from Metaflow. I added this as a Metaflow configuration called BATCH_CONTAINER_IMAGE_CREDS_SECRET, to the @batch decorator as repo_creds_secret, and to the batch cli as --repo-creds-secret.
As mentioned in #1820, there is currently no way to authenticate with a private container image repo for Batch. In AWS, the ARN of a secret containing those credentials can be included in the job definition, which is what I've exposed from Metaflow. I added this as a Metaflow configuration called
BATCH_CONTAINER_IMAGE_CREDS_SECRET
, to the@batch
decorator asrepo_creds_secret
, and to the batch cli as--repo-creds-secret
.