search

cal-itp / data-infra

Cal-ITP data infrastructure
https://docs.calitp.org/data-infra
GNU Affero General Public License v3.0
48 stars 13 forks source link

chore(deps-dev): bump apache-airflow from 2.4.3 to 2.10.3 in /airflow #3535

Open dependabot[bot] opened 1 week ago

dependabot[bot] commented 1 week ago

Bumps apache-airflow from 2.4.3 to 2.10.3.

Release notes

Sourced from apache-airflow's releases.

Apache Airflow 2.10.3

Significant Changes

No significant changes.

Bug Fixes

  • Improves the handling of value masking when setting Airflow variables for enhanced security. (#43123) (#43278)
  • Adds support for task_instance_mutation_hook to handle mapped operators with index 0. (#42661) (#43089)
  • Fixes executor cleanup to properly handle zombie tasks when task instances are terminated. (#43065)
  • Adds retry logic for HTTP 502 and 504 errors in internal API calls to handle webserver startup issues. (#42994) (#43044)
  • Restores the use of separate sessions for writing and deleting RTIF data to prevent StaleDataError. (#42928) (#43012)
  • Fixes PythonOperator error by replacing hyphens with underscores in DAG names. (#42993)
  • Improving validation of task retries to handle None values (#42532) (#42915)
  • Fixes error handling in dataset managers when resolving dataset aliases into new datasets (#42733)
  • Enables clicking on task names in the DAG Graph View to correctly select the corresponding task. (#38782) (#42697)
  • Prevent redirect loop on /home with tags/last run filters (#42607) (#42609) (#42628)
  • Support of host.name in OTEL metrics and usage of OTEL_RESOURCE_ATTRIBUTES in metrics (#42428) (#42604)
  • Reduce eyestrain in dark mode with reduced contrast and saturation (#42567) (#42583)
  • Handle ENTER key correctly in trigger form and allow manual JSON (#42525) (#42535)
  • Ensure DAG trigger form submits with updated parameters upon keyboard submit (#42487) (#42499)
  • Do not attempt to provide not stringified objects to UI via xcom if pickling is active (#42388) (#42486)
  • Fix the span link of task instance to point to the correct span in the scheduler_job_loop (#42430) (#42480)
  • Bugfix task execution from runner in Windows (#42426) (#42478)
  • Allows overriding the hardcoded OTEL_SERVICE_NAME with an environment variable (#42242) (#42441)
  • Improves trigger performance by using selectinload instead of joinedload (#40487) (#42351)
  • Suppress warnings when masking sensitive configs (#43335) (#43337)
  • Masking configuration values irrelevant to DAG author (#43040) (#43336)
  • Execute templated bash script as file in BashOperator (#43191)
  • Fixes schedule_downstream_tasks to include upstream tasks for one_success trigger rule (#42582) (#43299)
  • Add retry logic in the scheduler for updating trigger timeouts in case of deadlocks. (#41429) (#42651)
  • Mark all tasks as skipped when failing a dag_run manually (#43572)
  • Fix TrySelector for Mapped Tasks in Logs and Details Grid Panel (#43566)
  • Conditionally add OTEL events when processing executor events (#43558) (#43567)
  • Fix broken stat scheduler_loop_duration (#42886) (#43544)
  • Ensure total_entries in /api/v1/dags (#43377) (#43429)
  • Include limit and offset in request body schema for List task instances (batch) endpoint (#43479)
  • Don't raise a warning in ExecutorSafeguard when execute is called from an extended operator (#42849) (#43577)

Miscellaneous

  • Deprecate session auth backend (#42911)
  • Removed unicodecsv dependency for providers with Airflow version 2.8.0 and above (#42765) (#42970)
  • Remove the referrer from Webserver to Scarf (#42901) (#42942)
  • Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
  • Correct docstring format in _get_template_context (#42244) (#42272)
  • Backport: Bump Flask-AppBuilder to 4.5.2 (#43309) (#43318)
  • Check python version that was used to install pre-commit venvs (#43282) (#43310)
  • Resolve warning in Dataset Alias migration (#43425)

... (truncated)

Changelog

Sourced from apache-airflow's changelog.

Airflow 2.10.3 (2024-11-05)

Significant Changes ^^^^^^^^^^^^^^^^^^^

No significant changes.

Bug Fixes """""""""

  • Improves the handling of value masking when setting Airflow variables for enhanced security. (#43123) (#43278)
  • Adds support for task_instance_mutation_hook to handle mapped operators with index 0. (#42661) (#43089)
  • Fixes executor cleanup to properly handle zombie tasks when task instances are terminated. (#43065)
  • Adds retry logic for HTTP 502 and 504 errors in internal API calls to handle webserver startup issues. (#42994) (#43044)
  • Restores the use of separate sessions for writing and deleting RTIF data to prevent StaleDataError. (#42928) (#43012)
  • Fixes PythonOperator error by replacing hyphens with underscores in DAG names. (#42993)
  • Improving validation of task retries to handle None values (#42532) (#42915)
  • Fixes error handling in dataset managers when resolving dataset aliases into new datasets (#42733)
  • Enables clicking on task names in the DAG Graph View to correctly select the corresponding task. (#38782) (#42697)
  • Prevent redirect loop on /home with tags/last run filters (#42607) (#42609) (#42628)
  • Support of host.name in OTEL metrics and usage of OTEL_RESOURCE_ATTRIBUTES in metrics (#42428) (#42604)
  • Reduce eyestrain in dark mode with reduced contrast and saturation (#42567) (#42583)
  • Handle ENTER key correctly in trigger form and allow manual JSON (#42525) (#42535)
  • Ensure DAG trigger form submits with updated parameters upon keyboard submit (#42487) (#42499)
  • Do not attempt to provide not stringified objects to UI via xcom if pickling is active (#42388) (#42486)
  • Fix the span link of task instance to point to the correct span in the scheduler_job_loop (#42430) (#42480)
  • Bugfix task execution from runner in Windows (#42426) (#42478)
  • Allows overriding the hardcoded OTEL_SERVICE_NAME with an environment variable (#42242) (#42441)
  • Improves trigger performance by using selectinload instead of joinedload (#40487) (#42351)
  • Suppress warnings when masking sensitive configs (#43335) (#43337)
  • Masking configuration values irrelevant to DAG author (#43040) (#43336)
  • Execute templated bash script as file in BashOperator (#43191)
  • Fixes schedule_downstream_tasks to include upstream tasks for one_success trigger rule (#42582) (#43299)
  • Add retry logic in the scheduler for updating trigger timeouts in case of deadlocks. (#41429) (#42651)
  • Mark all tasks as skipped when failing a dag_run manually (#43572)
  • Fix TrySelector for Mapped Tasks in Logs and Details Grid Panel (#43566)
  • Conditionally add OTEL events when processing executor events (#43558) (#43567)
  • Fix broken stat scheduler_loop_duration (#42886) (#43544)
  • Ensure total_entries in /api/v1/dags (#43377) (#43429)
  • Include limit and offset in request body schema for List task instances (batch) endpoint (#43479)
  • Don't raise a warning in ExecutorSafeguard when execute is called from an extended operator (#42849) (#43577)

Miscellaneous """""""""""""

  • Deprecate session auth backend (#42911)
  • Removed unicodecsv dependency for providers with Airflow version 2.8.0 and above (#42765) (#42970)
  • Remove the referrer from Webserver to Scarf (#42901) (#42942)
  • Bump dompurify from 2.2.9 to 2.5.6 in /airflow/www (#42263) (#42270)
  • Correct docstring format in _get_template_context (#42244) (#42272)
  • Backport: Bump Flask-AppBuilder to 4.5.2 (#43309) (#43318)

... (truncated)

Commits
  • c99887e Update RELEASE_NOTES.rst
  • 1c7fba7 mark test_task_workflow_trigger_success as flaky (#42972) (#43580)
  • 08bbf89 FIX: Don't raise a warning in ExecutorSafeguard when execute is called from a...
  • 7e86bf8 Mark all tasks as skipped when failing a dag_run manually including t… (#43572)
  • 8e79c7a Fix TrySelector for Mapped Tasks in Logs and Details Grid Panel (#43566)
  • c12e628 Conditionally add OTEL events when processing executor events (#43558) (#43567)
  • 898f332 Fix broken stat scheduler_loop_duration (#42886) (#43544)
  • 7aea4b5 Ensure total_entries in /api/v1/dags (#43377) (#43429)
  • 9c044ea include limit and offset in request body schema for List task instances (batc...
  • dd296c5 This PR resolves an SQLAlchemy warning in the migration by correctly setting ...
  • Additional commits viewable in compare view


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/cal-itp/data-infra/network/alerts).