aws / amazon-mwaa-docker-images

Apache License 2.0
27 stars 12 forks source link

Fix duplicated scheduler processes + make all airflow processes essen… #133

Closed Kytha closed 2 months ago

Kytha commented 2 months ago

Description of changes:

Found a bug during performance benchmarking where there were duplicates of all scheduler airflow processes running on a scheduler container (so 1 container had 2 schedulers running).

This PR fixes this issue and also fixes issue where worker and webserver processes are not treated as essential (meaning failed conditions would not cause container to exit).

Tested deploying image locally and deploying to mwaa dev environment.