We need to implement a unified health check script that can be used to assess the health of the container, e.g. via Docker Compose on Fargate. It doesn't have to have sophisticated health check mechanism at this point, just something simple (e.g. confirming the airflow process is running) so that we can build on it later.
Acceptance Criteria
A health check script with a simple implementation, e.g. confirming the Airflow process is running.
We need to cover the scheduler, web server, and triggerer.
Worker can be covered as well if the health check provided by Airflow works out of the box with SQS.
We need to make sure we are not overloading the web server by our health checks.
We also need to update our Docker Compose setup to employ the outcome script of this issue.
Overview
We need to implement a unified health check script that can be used to assess the health of the container, e.g. via Docker Compose on Fargate. It doesn't have to have sophisticated health check mechanism at this point, just something simple (e.g. confirming the airflow process is running) so that we can build on it later.
Acceptance Criteria