ukwa / ukwa-services

Deployment configuration for all UKWA services stacks.
Apache License 2.0
4 stars 5 forks source link

Update Airflow to 2.5.3 #109

Closed anjackson closed 1 year ago

anjackson commented 1 year ago

Production Airflow is a bit old so update it to make sure we get fixes etc.

anjackson commented 1 year ago

The main update went smoothly. There were some old data that had to be cleaned up as per https://airflow.apache.org/docs/apache-airflow/2.5.3/installation/upgrading.html#post-upgrade-warnings

The airflow_db_cleanup DAG did not work, but as we have a more recent version of Airflow, could be updated to use airflow db clean. See https://github.com/ukwa/ukwa-services/blob/master/manage/airflow/dags/airflow_db_cleanup.py