AllenInstitute / ophys_etl_pipelines

Pipelines and modules for processing optical physiology data
Other
9 stars 5 forks source link

PSB-234 Fetch secret variables and add app_config.yml #615

Closed aamster closed 11 months ago

aamster commented 11 months ago

Adds staging.app_config.yml Removes sensitive/static configs and places in AWS secrets manager

aamster commented 11 months ago

@morriscb the only requirement is that the sensitive configs be stored in AWS secrets manager in a certain format and the values.yaml file updated to tell airflow to pull Variable from the secrets manager. It's pretty straightforward.