Deploy Airflow to Dev

[averyniceday]

Done Condition: Airflow is setup in dev cluster and available for testing - configurations and documentation checked in

[jamesqo]

What's left (bold = blocked):

• [ ] Deploying Helm chart

  • [ ] Automatic volume setup

  • [x] EFS installation

  • [x] Update trust policy to enable EFS installation

  • [x] Install EFS plugin for EKS

  • [x] Create EFS filesystem

  • [x] Git sync

  • [x] Enable cloning of Git repos on dev cluster using SSH url (git@)

    • [x] Enable incoming SSH connections from github.comand github.mskcc.org (waiting on Kiran)

  • [x] Investigate problems running commands via kubectl exec

• [ ] Commit configuration files