cal-itp / data-infra

Cal-ITP data infrastructure
https://docs.calitp.org/data-infra
GNU Affero General Public License v3.0
47 stars 12 forks source link

Bug: DeprecationWarning about sql_alchemy_conn when running airflow jobs locally #3380

Open vevetron opened 3 months ago

vevetron commented 3 months ago

Describe the bug warning message when running airflow locally: /home/airflow/.local/lib/python3.8/site-packages/airflow/configuration.py:545: DeprecationWarning: The sql_alchemy_conn option in [core] has been moved to the sql_alchemy_conn option in [database] - the old setting has been used, but please update your config. option = self._get_environment_variables(deprecated_key, deprecated_section, key, section) /home/airflow/.local/lib/python3.8/site-packages/airflow/configuration.py:545 DeprecationWarning: The base_log_folder option in [core] has been moved to the base_log_folder option in [logging] - the old setting has been used, but please update your config. [2024-06-24 20:47:32,566] {dagbag.py:537} INFO - Filling up the DagBag from /opt/***/gcs/dags /home/airflow/.local/lib/python3.8/site-packages/airflow/configuration.py:545 DeprecationWarning: The sql_alchemy_conn option in [core] has been moved to the sql_alchemy_conn option in [database] - the old setting has been used, but please update your config.

To Reproduce Run any dag locally like this: docker-compose run airflow tasks run unzip_and_validate_gtfs_schedule_hourly stop_times_txt 2024-06-15T03:00:00+00:00

Expected behavior A certain lack of DeprecationWarnings Additional context Might be related to using an old version of sql_alchemy? not sure.