ResourceInitializationError: unable to pull secrets or registry auth: execution resource retrieval failed: unable to retrieve secret from asm: service call has been retried 5 time(s): failed to fetch secret

aws-samples / dataops-platform-airflow-dbt

Build DataOps platform with Apache Airflow and dbt on AWS

https://aws.amazon.com/tr/blogs/big-data/build-a-dataops-platform-to-break-silos-between-engineers-and-analysts/?nc1=h_ls&advocacy_source=everyonesocial&trk=global_employee_advocacy&sc_channel=sm&es_id=ab2ae17684

MIT No Attribution

51 stars 14 forks source link

ResourceInitializationError: unable to pull secrets or registry auth: execution resource retrieval failed: unable to retrieve secret from asm: service call has been retried 5 time(s): failed to fetch secret #12

Closed Tres33 closed 3 years ago

Tres33 commented 3 years ago

When I run make deploy, I get a ResourceInitializationError error while initializing the fargate services in MyCluster. I was able to fix this by setting assign_public_ip to True for the 3 services in dataops-infra/infra/stacks/fargate_services/airflow.py. However, when I run the redshift_transformations dag on Airflow, I get the same error when running task dbt-cdk. May I know how I could debug this? Thanks!

dzeno commented 3 years ago

Hello @Tres33 ! Thanks for raising this issue. Fixed in https://github.com/aws-samples/dataops-platform-airflow-dbt/pull/13

Tres33 commented 3 years ago

Works on my end. Thanks!