apache/airflow
### [`v2.5.2`](https://togithub.com/apache/airflow/blob/HEAD/RELEASE_NOTES.rst#Airflow-252-2023-03-15)
[Compare Source](https://togithub.com/apache/airflow/compare/2.5.1...2.5.2)
Significant Changes
^^^^^^^^^^^^^^^^^^^
The date-time fields passed as API parameters or Params should be RFC3339-compliant ([#29395](https://togithub.com/apache/airflow/issues/29395))
""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""
In case of API calls, it was possible that "+" passed as part of the date-time fields were not URL-encoded, and
such date-time fields could pass validation. Such date-time parameters should now be URL-encoded (as `%2B`).
In case of parameters, we still allow IS8601-compliant date-time (so for example it is possible that
' ' was used instead of `T` separating date from time and no timezone was specified) but we raise
deprecation warning.
Default for `[webserver] expose_hostname` changed to `False` ([#29547](https://togithub.com/apache/airflow/issues/29547))
"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""
The default for `[webserver] expose_hostname` has been set to `False`, instead of `True`. This means administrators must opt-in to expose webserver hostnames to end users.
Bug Fixes
^^^^^^^^^
- Fix validation of date-time field in API and Parameter schemas ([#29395](https://togithub.com/apache/airflow/issues/29395))
- Fix grid logs for large logs ([#29390](https://togithub.com/apache/airflow/issues/29390))
- Fix on_failure_callback when task receives a SIGTERM ([#29743](https://togithub.com/apache/airflow/issues/29743))
- Update min version of python-daemon to fix containerd file limits ([#29916](https://togithub.com/apache/airflow/issues/29916))
- POST `/dagRuns` API should 404 if dag not active ([#29860](https://togithub.com/apache/airflow/issues/29860))
- DAG list sorting lost when switching page ([#29756](https://togithub.com/apache/airflow/issues/29756))
- Fix Scheduler crash when clear a previous run of a normal task that is now a mapped task ([#29645](https://togithub.com/apache/airflow/issues/29645))
- Convert moment with timezone to UTC instead of raising an exception ([#29606](https://togithub.com/apache/airflow/issues/29606))
- Fix clear dag run `openapi` spec responses by adding additional return type ([#29600](https://togithub.com/apache/airflow/issues/29600))
- Don't display empty rendered attrs in Task Instance Details page ([#29545](https://togithub.com/apache/airflow/issues/29545))
- Remove section check from get-value command ([#29541](https://togithub.com/apache/airflow/issues/29541))
- Do not show version/node in UI traceback for unauthenticated user ([#29501](https://togithub.com/apache/airflow/issues/29501))
- Make `prev_logical_date` variable offset-aware ([#29454](https://togithub.com/apache/airflow/issues/29454))
- Fix nested fields rendering in mapped operators ([#29451](https://togithub.com/apache/airflow/issues/29451))
- Datasets, next_run_datasets, remove unnecessary timestamp filter ([#29441](https://togithub.com/apache/airflow/issues/29441))
- `Edgemodifier` refactoring w/ labels in TaskGroup edge case ([#29410](https://togithub.com/apache/airflow/issues/29410))
- Fix Rest API update user output ([#29409](https://togithub.com/apache/airflow/issues/29409))
- Ensure Serialized DAG is deleted ([#29407](https://togithub.com/apache/airflow/issues/29407))
- Persist DAG and task doc values in TaskFlow API if explicitly set ([#29399](https://togithub.com/apache/airflow/issues/29399))
- Redirect to the origin page with all the params ([#29212](https://togithub.com/apache/airflow/issues/29212))
- Fixing Task Duration view in case of manual DAG runs only ([#22015](https://togithub.com/apache/airflow/issues/22015)) ([#29195](https://togithub.com/apache/airflow/issues/29195))
- Remove poke method to fall back to parent implementation ([#29146](https://togithub.com/apache/airflow/issues/29146))
- PR: Introduced fix to run tasks on Windows systems ([#29107](https://togithub.com/apache/airflow/issues/29107))
- Fix warning in migrations about old config. ([#29092](https://togithub.com/apache/airflow/issues/29092))
- Emit dagrun failed duration when timeout ([#29076](https://togithub.com/apache/airflow/issues/29076))
- Handling error on cluster policy itself ([#29056](https://togithub.com/apache/airflow/issues/29056))
- Fix kerberos authentication for the REST API. ([#29054](https://togithub.com/apache/airflow/issues/29054))
- Fix leak sensitive field via V1EnvVar on exception ([#29016](https://togithub.com/apache/airflow/issues/29016))
- Sanitize url_for arguments before they are passed ([#29039](https://togithub.com/apache/airflow/issues/29039))
- Fix dag run trigger with a note. ([#29228](https://togithub.com/apache/airflow/issues/29228))
- Write action log to DB when DAG run is triggered via API ([#28998](https://togithub.com/apache/airflow/issues/28998))
- Resolve all variables in pickled XCom iterator ([#28982](https://togithub.com/apache/airflow/issues/28982))
- Allow URI without authority and host blocks in `airflow connections add` ([#28922](https://togithub.com/apache/airflow/issues/28922))
- Be more selective when adopting pods with KubernetesExecutor ([#28899](https://togithub.com/apache/airflow/issues/28899))
- KubenetesExecutor sends state even when successful ([#28871](https://togithub.com/apache/airflow/issues/28871))
- Annotate KubernetesExecutor pods that we don't delete ([#28844](https://togithub.com/apache/airflow/issues/28844))
- Throttle streaming log reads ([#28818](https://togithub.com/apache/airflow/issues/28818))
- Introduce dag processor job ([#28799](https://togithub.com/apache/airflow/issues/28799))
- Fix [#28391](https://togithub.com/apache/airflow/issues/28391) manual task trigger from UI fails for k8s executor ([#28394](https://togithub.com/apache/airflow/issues/28394))
- Logging poke info when external dag is not none and task_id and task_ids are none ([#28097](https://togithub.com/apache/airflow/issues/28097))
- Fix inconsistencies in checking edit permissions for a DAG ([#20346](https://togithub.com/apache/airflow/issues/20346))
Misc/Internal
^^^^^^^^^^^^^
- Add a check for not templateable fields ([#29821](https://togithub.com/apache/airflow/issues/29821))
- Removed continue for not in ([#29791](https://togithub.com/apache/airflow/issues/29791))
- Move extra links position in grid view ([#29703](https://togithub.com/apache/airflow/issues/29703))
- Bump `undici` from `5.9.1` to `5.19.1` ([#29583](https://togithub.com/apache/airflow/issues/29583))
- Change expose_hostname default to false ([#29547](https://togithub.com/apache/airflow/issues/29547))
- Change permissions of config/password files created by airflow ([#29495](https://togithub.com/apache/airflow/issues/29495))
- Use newer setuptools `v67.2.0` ([#29465](https://togithub.com/apache/airflow/issues/29465))
- Increase max height for grid view elements ([#29367](https://togithub.com/apache/airflow/issues/29367))
- Clarify description of worker control config ([#29247](https://togithub.com/apache/airflow/issues/29247))
- Bump `ua-parser-js` from `0.7.31` to `0.7.33` in `/airflow/www` ([#29172](https://togithub.com/apache/airflow/issues/29172))
- Remove upper bound limitation for `pytest` ([#29086](https://togithub.com/apache/airflow/issues/29086))
- Check for `run_id` url param when linking to `graph/gantt` views ([#29066](https://togithub.com/apache/airflow/issues/29066))
- Clarify graph view dynamic task labels ([#29042](https://togithub.com/apache/airflow/issues/29042))
- Fixing import error for dataset ([#29007](https://togithub.com/apache/airflow/issues/29007))
- Update how PythonSensor returns values from `python_callable` ([#28932](https://togithub.com/apache/airflow/issues/28932))
- Add dep context description for better log message ([#28875](https://togithub.com/apache/airflow/issues/28875))
- Bump `swagger-ui-dist` from `3.52.0` to `4.1.3` in `/airflow/www` ([#28824](https://togithub.com/apache/airflow/issues/28824))
- Limit `importlib-metadata` backport to `< 5.0.0` ([#29924](https://togithub.com/apache/airflow/issues/29924), [#30069](https://togithub.com/apache/airflow/issues/30069))
Doc Only Changes
^^^^^^^^^^^^^^^^
- Update pipeline.rst - Fix query in `merge_data()` task ([#29158](https://togithub.com/apache/airflow/issues/29158))
- Correct argument name of Workday timetable in timetable.rst ([#29896](https://togithub.com/apache/airflow/issues/29896))
- Update ref anchor for env var link in Connection how-to doc ([#29816](https://togithub.com/apache/airflow/issues/29816))
- Better description for limit in api ([#29773](https://togithub.com/apache/airflow/issues/29773))
- Description of dag_processing.last_duration ([#29740](https://togithub.com/apache/airflow/issues/29740))
- Update docs re: template_fields typing and subclasses ([#29725](https://togithub.com/apache/airflow/issues/29725))
- Fix formatting of Dataset inlet/outlet note in TaskFlow concepts ([#29678](https://togithub.com/apache/airflow/issues/29678))
- Specific use-case: adding packages via requirements.txt in compose ([#29598](https://togithub.com/apache/airflow/issues/29598))
- Detect is 'docker-compose' existing ([#29544](https://togithub.com/apache/airflow/issues/29544))
- Add Landing Times entry to UI docs ([#29511](https://togithub.com/apache/airflow/issues/29511))
- Improve health checks in example docker-compose and clarify usage ([#29408](https://togithub.com/apache/airflow/issues/29408))
- Remove `notes` param from TriggerDagRunOperator docstring ([#29298](https://togithub.com/apache/airflow/issues/29298))
- Use `schedule` param rather than `timetable` in Timetables docs ([#29255](https://togithub.com/apache/airflow/issues/29255))
- Add trigger process to Airflow Docker docs ([#29203](https://togithub.com/apache/airflow/issues/29203))
- Update set-up-database.rst ([#29104](https://togithub.com/apache/airflow/issues/29104))
- Several improvements to the Params doc ([#29062](https://togithub.com/apache/airflow/issues/29062))
- Email Config docs more explicit env var examples ([#28845](https://togithub.com/apache/airflow/issues/28845))
- Listener plugin example added ([#27905](https://togithub.com/apache/airflow/issues/27905))
### [`v2.5.1`](https://togithub.com/apache/airflow/blob/HEAD/RELEASE_NOTES.rst#Airflow-251-2023-01-20)
[Compare Source](https://togithub.com/apache/airflow/compare/2.5.0...2.5.1)
Significant Changes
^^^^^^^^^^^^^^^^^^^
Trigger gevent `monkeypatching` via environment variable ([#28283](https://togithub.com/apache/airflow/issues/28283))
"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""
If you are using gevent for your webserver deployment and used local settings to `monkeypatch` gevent,
you might want to replace local settings patching with an `_AIRFLOW_PATCH_GEVENT` environment variable
set to 1 in your webserver. This ensures gevent patching is done as early as possible.
Bug Fixes
^^^^^^^^^
- Fix masking of non-sensitive environment variables ([#28802](https://togithub.com/apache/airflow/issues/28802))
- Remove swagger-ui extra from connexion and install `swagger-ui-dist` via npm package ([#28788](https://togithub.com/apache/airflow/issues/28788))
- Fix `UIAlert` should_show when `AUTH_ROLE_PUBLIC` set ([#28781](https://togithub.com/apache/airflow/issues/28781))
- Only patch single label when adopting pod ([#28776](https://togithub.com/apache/airflow/issues/28776))
- Update CSRF token to expire with session ([#28730](https://togithub.com/apache/airflow/issues/28730))
- Fix "airflow tasks render" cli command for mapped task instances ([#28698](https://togithub.com/apache/airflow/issues/28698))
- Allow XComArgs for `external_task_ids` of ExternalTaskSensor ([#28692](https://togithub.com/apache/airflow/issues/28692))
- Row-lock TIs to be removed during mapped task expansion ([#28689](https://togithub.com/apache/airflow/issues/28689))
- Handle ConnectionReset exception in Executor cleanup ([#28685](https://togithub.com/apache/airflow/issues/28685))
- Fix description of output redirection for access_log for gunicorn ([#28672](https://togithub.com/apache/airflow/issues/28672))
- Add back join to zombie query that was dropped in [#28198](https://togithub.com/apache/airflow/issues/28198) ([#28544](https://togithub.com/apache/airflow/issues/28544))
- Fix calendar view for CronTriggerTimeTable dags ([#28411](https://togithub.com/apache/airflow/issues/28411))
- After running the DAG the employees table is empty. ([#28353](https://togithub.com/apache/airflow/issues/28353))
- Fix `DetachedInstanceError` when finding zombies in Dag Parsing process ([#28198](https://togithub.com/apache/airflow/issues/28198))
- Nest header blocks in `divs` to fix `dagid` copy nit on dag.html ([#28643](https://togithub.com/apache/airflow/issues/28643))
- Fix UI caret direction ([#28624](https://togithub.com/apache/airflow/issues/28624))
- Guard not-yet-expanded ti in trigger rule dep ([#28592](https://togithub.com/apache/airflow/issues/28592))
- Move TI `setNote` endpoints under TaskInstance in OpenAPI ([#28566](https://togithub.com/apache/airflow/issues/28566))
- Consider previous run in `CronTriggerTimetable` ([#28532](https://togithub.com/apache/airflow/issues/28532))
- Ensure correct log dir in file task handler ([#28477](https://togithub.com/apache/airflow/issues/28477))
- Fix bad pods pickled in executor_config ([#28454](https://togithub.com/apache/airflow/issues/28454))
- Add `ensure_ascii=False` in trigger dag run API ([#28451](https://togithub.com/apache/airflow/issues/28451))
- Add setters to MappedOperator on_\*\_callbacks ([#28313](https://togithub.com/apache/airflow/issues/28313))
- Fix `ti._try_number` for deferred and up_for_reschedule tasks ([#26993](https://togithub.com/apache/airflow/issues/26993))
- separate `callModal` from dag.js ([#28410](https://togithub.com/apache/airflow/issues/28410))
- A manual run can't look like a scheduled one ([#28397](https://togithub.com/apache/airflow/issues/28397))
- Dont show task/run durations when there is no start_date ([#28395](https://togithub.com/apache/airflow/issues/28395))
- Maintain manual scroll position in task logs ([#28386](https://togithub.com/apache/airflow/issues/28386))
- Correctly select a mapped task's "previous" task ([#28379](https://togithub.com/apache/airflow/issues/28379))
- Trigger gevent `monkeypatching` via environment variable ([#28283](https://togithub.com/apache/airflow/issues/28283))
- Fix db clean warnings ([#28243](https://togithub.com/apache/airflow/issues/28243))
- Make arguments 'offset' and 'length' not required ([#28234](https://togithub.com/apache/airflow/issues/28234))
- Make live logs reading work for "other" k8s executors ([#28213](https://togithub.com/apache/airflow/issues/28213))
- Add custom pickling hooks to `LazyXComAccess` ([#28191](https://togithub.com/apache/airflow/issues/28191))
- fix next run datasets error ([#28165](https://togithub.com/apache/airflow/issues/28165))
- Ensure that warnings from `@dag` decorator are reported in dag file ([#28153](https://togithub.com/apache/airflow/issues/28153))
- Do not warn when airflow dags tests command is used ([#28138](https://togithub.com/apache/airflow/issues/28138))
- Ensure the `dagbag_size` metric decreases when files are deleted ([#28135](https://togithub.com/apache/airflow/issues/28135))
- Improve run/task grid view actions ([#28130](https://togithub.com/apache/airflow/issues/28130))
- Make BaseJob.most_recent_job favor "running" jobs ([#28119](https://togithub.com/apache/airflow/issues/28119))
- Don't emit FutureWarning when code not calling old key ([#28109](https://togithub.com/apache/airflow/issues/28109))
- Add `airflow.api.auth.backend.session` to backend sessions in compose ([#28094](https://togithub.com/apache/airflow/issues/28094))
- Resolve false warning about calling conf.get on moved item ([#28075](https://togithub.com/apache/airflow/issues/28075))
- Return list of tasks that will be changed ([#28066](https://togithub.com/apache/airflow/issues/28066))
- Handle bad zip files nicely when parsing DAGs. ([#28011](https://togithub.com/apache/airflow/issues/28011))
- Prevent double loading of providers from local paths ([#27988](https://togithub.com/apache/airflow/issues/27988))
- Fix deadlock when chaining multiple empty mapped tasks ([#27964](https://togithub.com/apache/airflow/issues/27964))
- fix: current_state method on TaskInstance doesn't filter by map_index ([#27898](https://togithub.com/apache/airflow/issues/27898))
- Don't log CLI actions if db not initialized ([#27851](https://togithub.com/apache/airflow/issues/27851))
- Make sure we can get out of a faulty scheduler state ([#27834](https://togithub.com/apache/airflow/issues/27834))
- dagrun, `next_dagruns_to_examine`, add MySQL index hint ([#27821](https://togithub.com/apache/airflow/issues/27821))
- Handle DAG disappearing mid-flight when dag verification happens ([#27720](https://togithub.com/apache/airflow/issues/27720))
- fix: continue checking sla ([#26968](https://togithub.com/apache/airflow/issues/26968))
- Allow generation of connection URI to work when no conn type ([#26765](https://togithub.com/apache/airflow/issues/26765))
Misc/Internal
^^^^^^^^^^^^^
- Remove limit for `dnspython` after eventlet got fixed ([#29004](https://togithub.com/apache/airflow/issues/29004))
- Limit `dnspython` to < `2.3.0` until eventlet incompatibility is solved ([#28962](https://togithub.com/apache/airflow/issues/28962))
- Add automated version replacement in example dag indexes ([#28090](https://togithub.com/apache/airflow/issues/28090))
- Cleanup and do housekeeping with plugin examples ([#28537](https://togithub.com/apache/airflow/issues/28537))
- Limit `SQLAlchemy` to below `2.0` ([#28725](https://togithub.com/apache/airflow/issues/28725))
- Bump `json5` from `1.0.1` to `1.0.2` in `/airflow/www` ([#28715](https://togithub.com/apache/airflow/issues/28715))
- Fix some docs on using sensors with taskflow ([#28708](https://togithub.com/apache/airflow/issues/28708))
- Change Architecture and OperatingSystem classes into `Enums` ([#28627](https://togithub.com/apache/airflow/issues/28627))
- Add doc-strings and small improvement to email util ([#28634](https://togithub.com/apache/airflow/issues/28634))
- Fix `Connection.get_extra` type ([#28594](https://togithub.com/apache/airflow/issues/28594))
- navbar, cap dropdown size, and add scroll bar ([#28561](https://togithub.com/apache/airflow/issues/28561))
- Emit warnings for `conf.get*` from the right source location ([#28543](https://togithub.com/apache/airflow/issues/28543))
- Move MyPY plugins of ours to dev folder ([#28498](https://togithub.com/apache/airflow/issues/28498))
- Add retry to `purge_inactive_dag_warnings` ([#28481](https://togithub.com/apache/airflow/issues/28481))
- Re-enable Plyvel on ARM as it now builds cleanly ([#28443](https://togithub.com/apache/airflow/issues/28443))
- Add SIGUSR2 handler for LocalTaskJob and workers to aid debugging ([#28309](https://togithub.com/apache/airflow/issues/28309))
- Convert `test_task_command` to Pytest and `unquarantine` tests in it ([#28247](https://togithub.com/apache/airflow/issues/28247))
- Make invalid characters exception more readable ([#28181](https://togithub.com/apache/airflow/issues/28181))
- Bump decode-uri-component from `0.2.0` to `0.2.2` in `/airflow/www` ([#28080](https://togithub.com/apache/airflow/issues/28080))
- Use asserts instead of exceptions for executor not started ([#28019](https://togithub.com/apache/airflow/issues/28019))
- Simplify dataset `subgraph` logic ([#27987](https://togithub.com/apache/airflow/issues/27987))
- Order TIs by `map_index` ([#27904](https://togithub.com/apache/airflow/issues/27904))
- Additional info about Segmentation Fault in `LocalTaskJob` ([#27381](https://togithub.com/apache/airflow/issues/27381))
Doc Only Changes
^^^^^^^^^^^^^^^^
- Mention mapped operator in cluster policy doc ([#28885](https://togithub.com/apache/airflow/issues/28885))
- Slightly improve description of Dynamic DAG generation preamble ([#28650](https://togithub.com/apache/airflow/issues/28650))
- Restructure Docs ([#27235](https://togithub.com/apache/airflow/issues/27235))
- Update scheduler docs about low priority tasks ([#28831](https://togithub.com/apache/airflow/issues/28831))
- Clarify that versioned constraints are fixed at release time ([#28762](https://togithub.com/apache/airflow/issues/28762))
- Clarify about docker compose ([#28729](https://togithub.com/apache/airflow/issues/28729))
- Adding an example dag for dynamic task mapping ([#28325](https://togithub.com/apache/airflow/issues/28325))
- Use docker compose v2 command ([#28605](https://togithub.com/apache/airflow/issues/28605))
- Add AIRFLOW_PROJ_DIR to docker-compose example ([#28517](https://togithub.com/apache/airflow/issues/28517))
- Remove outdated Optional Provider Feature outdated documentation ([#28506](https://togithub.com/apache/airflow/issues/28506))
- Add documentation for \[core] mp_start_method config ([#27993](https://togithub.com/apache/airflow/issues/27993))
- Documentation for the LocalTaskJob return code counter ([#27972](https://togithub.com/apache/airflow/issues/27972))
- Note which versions of Python are supported ([#27798](https://togithub.com/apache/airflow/issues/27798))
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
[ ] If you want to rebase/retry this PR, check this box
This PR has been generated by Mend Renovate. View repository job log here.
This PR contains the following updates:
2.5.0
->2.5.2
Release Notes
apache/airflow
### [`v2.5.2`](https://togithub.com/apache/airflow/blob/HEAD/RELEASE_NOTES.rst#Airflow-252-2023-03-15) [Compare Source](https://togithub.com/apache/airflow/compare/2.5.1...2.5.2) Significant Changes ^^^^^^^^^^^^^^^^^^^ The date-time fields passed as API parameters or Params should be RFC3339-compliant ([#29395](https://togithub.com/apache/airflow/issues/29395)) """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" In case of API calls, it was possible that "+" passed as part of the date-time fields were not URL-encoded, and such date-time fields could pass validation. Such date-time parameters should now be URL-encoded (as `%2B`). In case of parameters, we still allow IS8601-compliant date-time (so for example it is possible that ' ' was used instead of `T` separating date from time and no timezone was specified) but we raise deprecation warning. Default for `[webserver] expose_hostname` changed to `False` ([#29547](https://togithub.com/apache/airflow/issues/29547)) """"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" The default for `[webserver] expose_hostname` has been set to `False`, instead of `True`. This means administrators must opt-in to expose webserver hostnames to end users. Bug Fixes ^^^^^^^^^ - Fix validation of date-time field in API and Parameter schemas ([#29395](https://togithub.com/apache/airflow/issues/29395)) - Fix grid logs for large logs ([#29390](https://togithub.com/apache/airflow/issues/29390)) - Fix on_failure_callback when task receives a SIGTERM ([#29743](https://togithub.com/apache/airflow/issues/29743)) - Update min version of python-daemon to fix containerd file limits ([#29916](https://togithub.com/apache/airflow/issues/29916)) - POST `/dagRuns` API should 404 if dag not active ([#29860](https://togithub.com/apache/airflow/issues/29860)) - DAG list sorting lost when switching page ([#29756](https://togithub.com/apache/airflow/issues/29756)) - Fix Scheduler crash when clear a previous run of a normal task that is now a mapped task ([#29645](https://togithub.com/apache/airflow/issues/29645)) - Convert moment with timezone to UTC instead of raising an exception ([#29606](https://togithub.com/apache/airflow/issues/29606)) - Fix clear dag run `openapi` spec responses by adding additional return type ([#29600](https://togithub.com/apache/airflow/issues/29600)) - Don't display empty rendered attrs in Task Instance Details page ([#29545](https://togithub.com/apache/airflow/issues/29545)) - Remove section check from get-value command ([#29541](https://togithub.com/apache/airflow/issues/29541)) - Do not show version/node in UI traceback for unauthenticated user ([#29501](https://togithub.com/apache/airflow/issues/29501)) - Make `prev_logical_date` variable offset-aware ([#29454](https://togithub.com/apache/airflow/issues/29454)) - Fix nested fields rendering in mapped operators ([#29451](https://togithub.com/apache/airflow/issues/29451)) - Datasets, next_run_datasets, remove unnecessary timestamp filter ([#29441](https://togithub.com/apache/airflow/issues/29441)) - `Edgemodifier` refactoring w/ labels in TaskGroup edge case ([#29410](https://togithub.com/apache/airflow/issues/29410)) - Fix Rest API update user output ([#29409](https://togithub.com/apache/airflow/issues/29409)) - Ensure Serialized DAG is deleted ([#29407](https://togithub.com/apache/airflow/issues/29407)) - Persist DAG and task doc values in TaskFlow API if explicitly set ([#29399](https://togithub.com/apache/airflow/issues/29399)) - Redirect to the origin page with all the params ([#29212](https://togithub.com/apache/airflow/issues/29212)) - Fixing Task Duration view in case of manual DAG runs only ([#22015](https://togithub.com/apache/airflow/issues/22015)) ([#29195](https://togithub.com/apache/airflow/issues/29195)) - Remove poke method to fall back to parent implementation ([#29146](https://togithub.com/apache/airflow/issues/29146)) - PR: Introduced fix to run tasks on Windows systems ([#29107](https://togithub.com/apache/airflow/issues/29107)) - Fix warning in migrations about old config. ([#29092](https://togithub.com/apache/airflow/issues/29092)) - Emit dagrun failed duration when timeout ([#29076](https://togithub.com/apache/airflow/issues/29076)) - Handling error on cluster policy itself ([#29056](https://togithub.com/apache/airflow/issues/29056)) - Fix kerberos authentication for the REST API. ([#29054](https://togithub.com/apache/airflow/issues/29054)) - Fix leak sensitive field via V1EnvVar on exception ([#29016](https://togithub.com/apache/airflow/issues/29016)) - Sanitize url_for arguments before they are passed ([#29039](https://togithub.com/apache/airflow/issues/29039)) - Fix dag run trigger with a note. ([#29228](https://togithub.com/apache/airflow/issues/29228)) - Write action log to DB when DAG run is triggered via API ([#28998](https://togithub.com/apache/airflow/issues/28998)) - Resolve all variables in pickled XCom iterator ([#28982](https://togithub.com/apache/airflow/issues/28982)) - Allow URI without authority and host blocks in `airflow connections add` ([#28922](https://togithub.com/apache/airflow/issues/28922)) - Be more selective when adopting pods with KubernetesExecutor ([#28899](https://togithub.com/apache/airflow/issues/28899)) - KubenetesExecutor sends state even when successful ([#28871](https://togithub.com/apache/airflow/issues/28871)) - Annotate KubernetesExecutor pods that we don't delete ([#28844](https://togithub.com/apache/airflow/issues/28844)) - Throttle streaming log reads ([#28818](https://togithub.com/apache/airflow/issues/28818)) - Introduce dag processor job ([#28799](https://togithub.com/apache/airflow/issues/28799)) - Fix [#28391](https://togithub.com/apache/airflow/issues/28391) manual task trigger from UI fails for k8s executor ([#28394](https://togithub.com/apache/airflow/issues/28394)) - Logging poke info when external dag is not none and task_id and task_ids are none ([#28097](https://togithub.com/apache/airflow/issues/28097)) - Fix inconsistencies in checking edit permissions for a DAG ([#20346](https://togithub.com/apache/airflow/issues/20346)) Misc/Internal ^^^^^^^^^^^^^ - Add a check for not templateable fields ([#29821](https://togithub.com/apache/airflow/issues/29821)) - Removed continue for not in ([#29791](https://togithub.com/apache/airflow/issues/29791)) - Move extra links position in grid view ([#29703](https://togithub.com/apache/airflow/issues/29703)) - Bump `undici` from `5.9.1` to `5.19.1` ([#29583](https://togithub.com/apache/airflow/issues/29583)) - Change expose_hostname default to false ([#29547](https://togithub.com/apache/airflow/issues/29547)) - Change permissions of config/password files created by airflow ([#29495](https://togithub.com/apache/airflow/issues/29495)) - Use newer setuptools `v67.2.0` ([#29465](https://togithub.com/apache/airflow/issues/29465)) - Increase max height for grid view elements ([#29367](https://togithub.com/apache/airflow/issues/29367)) - Clarify description of worker control config ([#29247](https://togithub.com/apache/airflow/issues/29247)) - Bump `ua-parser-js` from `0.7.31` to `0.7.33` in `/airflow/www` ([#29172](https://togithub.com/apache/airflow/issues/29172)) - Remove upper bound limitation for `pytest` ([#29086](https://togithub.com/apache/airflow/issues/29086)) - Check for `run_id` url param when linking to `graph/gantt` views ([#29066](https://togithub.com/apache/airflow/issues/29066)) - Clarify graph view dynamic task labels ([#29042](https://togithub.com/apache/airflow/issues/29042)) - Fixing import error for dataset ([#29007](https://togithub.com/apache/airflow/issues/29007)) - Update how PythonSensor returns values from `python_callable` ([#28932](https://togithub.com/apache/airflow/issues/28932)) - Add dep context description for better log message ([#28875](https://togithub.com/apache/airflow/issues/28875)) - Bump `swagger-ui-dist` from `3.52.0` to `4.1.3` in `/airflow/www` ([#28824](https://togithub.com/apache/airflow/issues/28824)) - Limit `importlib-metadata` backport to `< 5.0.0` ([#29924](https://togithub.com/apache/airflow/issues/29924), [#30069](https://togithub.com/apache/airflow/issues/30069)) Doc Only Changes ^^^^^^^^^^^^^^^^ - Update pipeline.rst - Fix query in `merge_data()` task ([#29158](https://togithub.com/apache/airflow/issues/29158)) - Correct argument name of Workday timetable in timetable.rst ([#29896](https://togithub.com/apache/airflow/issues/29896)) - Update ref anchor for env var link in Connection how-to doc ([#29816](https://togithub.com/apache/airflow/issues/29816)) - Better description for limit in api ([#29773](https://togithub.com/apache/airflow/issues/29773)) - Description of dag_processing.last_duration ([#29740](https://togithub.com/apache/airflow/issues/29740)) - Update docs re: template_fields typing and subclasses ([#29725](https://togithub.com/apache/airflow/issues/29725)) - Fix formatting of Dataset inlet/outlet note in TaskFlow concepts ([#29678](https://togithub.com/apache/airflow/issues/29678)) - Specific use-case: adding packages via requirements.txt in compose ([#29598](https://togithub.com/apache/airflow/issues/29598)) - Detect is 'docker-compose' existing ([#29544](https://togithub.com/apache/airflow/issues/29544)) - Add Landing Times entry to UI docs ([#29511](https://togithub.com/apache/airflow/issues/29511)) - Improve health checks in example docker-compose and clarify usage ([#29408](https://togithub.com/apache/airflow/issues/29408)) - Remove `notes` param from TriggerDagRunOperator docstring ([#29298](https://togithub.com/apache/airflow/issues/29298)) - Use `schedule` param rather than `timetable` in Timetables docs ([#29255](https://togithub.com/apache/airflow/issues/29255)) - Add trigger process to Airflow Docker docs ([#29203](https://togithub.com/apache/airflow/issues/29203)) - Update set-up-database.rst ([#29104](https://togithub.com/apache/airflow/issues/29104)) - Several improvements to the Params doc ([#29062](https://togithub.com/apache/airflow/issues/29062)) - Email Config docs more explicit env var examples ([#28845](https://togithub.com/apache/airflow/issues/28845)) - Listener plugin example added ([#27905](https://togithub.com/apache/airflow/issues/27905)) ### [`v2.5.1`](https://togithub.com/apache/airflow/blob/HEAD/RELEASE_NOTES.rst#Airflow-251-2023-01-20) [Compare Source](https://togithub.com/apache/airflow/compare/2.5.0...2.5.1) Significant Changes ^^^^^^^^^^^^^^^^^^^ Trigger gevent `monkeypatching` via environment variable ([#28283](https://togithub.com/apache/airflow/issues/28283)) """"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" If you are using gevent for your webserver deployment and used local settings to `monkeypatch` gevent, you might want to replace local settings patching with an `_AIRFLOW_PATCH_GEVENT` environment variable set to 1 in your webserver. This ensures gevent patching is done as early as possible. Bug Fixes ^^^^^^^^^ - Fix masking of non-sensitive environment variables ([#28802](https://togithub.com/apache/airflow/issues/28802)) - Remove swagger-ui extra from connexion and install `swagger-ui-dist` via npm package ([#28788](https://togithub.com/apache/airflow/issues/28788)) - Fix `UIAlert` should_show when `AUTH_ROLE_PUBLIC` set ([#28781](https://togithub.com/apache/airflow/issues/28781)) - Only patch single label when adopting pod ([#28776](https://togithub.com/apache/airflow/issues/28776)) - Update CSRF token to expire with session ([#28730](https://togithub.com/apache/airflow/issues/28730)) - Fix "airflow tasks render" cli command for mapped task instances ([#28698](https://togithub.com/apache/airflow/issues/28698)) - Allow XComArgs for `external_task_ids` of ExternalTaskSensor ([#28692](https://togithub.com/apache/airflow/issues/28692)) - Row-lock TIs to be removed during mapped task expansion ([#28689](https://togithub.com/apache/airflow/issues/28689)) - Handle ConnectionReset exception in Executor cleanup ([#28685](https://togithub.com/apache/airflow/issues/28685)) - Fix description of output redirection for access_log for gunicorn ([#28672](https://togithub.com/apache/airflow/issues/28672)) - Add back join to zombie query that was dropped in [#28198](https://togithub.com/apache/airflow/issues/28198) ([#28544](https://togithub.com/apache/airflow/issues/28544)) - Fix calendar view for CronTriggerTimeTable dags ([#28411](https://togithub.com/apache/airflow/issues/28411)) - After running the DAG the employees table is empty. ([#28353](https://togithub.com/apache/airflow/issues/28353)) - Fix `DetachedInstanceError` when finding zombies in Dag Parsing process ([#28198](https://togithub.com/apache/airflow/issues/28198)) - Nest header blocks in `divs` to fix `dagid` copy nit on dag.html ([#28643](https://togithub.com/apache/airflow/issues/28643)) - Fix UI caret direction ([#28624](https://togithub.com/apache/airflow/issues/28624)) - Guard not-yet-expanded ti in trigger rule dep ([#28592](https://togithub.com/apache/airflow/issues/28592)) - Move TI `setNote` endpoints under TaskInstance in OpenAPI ([#28566](https://togithub.com/apache/airflow/issues/28566)) - Consider previous run in `CronTriggerTimetable` ([#28532](https://togithub.com/apache/airflow/issues/28532)) - Ensure correct log dir in file task handler ([#28477](https://togithub.com/apache/airflow/issues/28477)) - Fix bad pods pickled in executor_config ([#28454](https://togithub.com/apache/airflow/issues/28454)) - Add `ensure_ascii=False` in trigger dag run API ([#28451](https://togithub.com/apache/airflow/issues/28451)) - Add setters to MappedOperator on_\*\_callbacks ([#28313](https://togithub.com/apache/airflow/issues/28313)) - Fix `ti._try_number` for deferred and up_for_reschedule tasks ([#26993](https://togithub.com/apache/airflow/issues/26993)) - separate `callModal` from dag.js ([#28410](https://togithub.com/apache/airflow/issues/28410)) - A manual run can't look like a scheduled one ([#28397](https://togithub.com/apache/airflow/issues/28397)) - Dont show task/run durations when there is no start_date ([#28395](https://togithub.com/apache/airflow/issues/28395)) - Maintain manual scroll position in task logs ([#28386](https://togithub.com/apache/airflow/issues/28386)) - Correctly select a mapped task's "previous" task ([#28379](https://togithub.com/apache/airflow/issues/28379)) - Trigger gevent `monkeypatching` via environment variable ([#28283](https://togithub.com/apache/airflow/issues/28283)) - Fix db clean warnings ([#28243](https://togithub.com/apache/airflow/issues/28243)) - Make arguments 'offset' and 'length' not required ([#28234](https://togithub.com/apache/airflow/issues/28234)) - Make live logs reading work for "other" k8s executors ([#28213](https://togithub.com/apache/airflow/issues/28213)) - Add custom pickling hooks to `LazyXComAccess` ([#28191](https://togithub.com/apache/airflow/issues/28191)) - fix next run datasets error ([#28165](https://togithub.com/apache/airflow/issues/28165)) - Ensure that warnings from `@dag` decorator are reported in dag file ([#28153](https://togithub.com/apache/airflow/issues/28153)) - Do not warn when airflow dags tests command is used ([#28138](https://togithub.com/apache/airflow/issues/28138)) - Ensure the `dagbag_size` metric decreases when files are deleted ([#28135](https://togithub.com/apache/airflow/issues/28135)) - Improve run/task grid view actions ([#28130](https://togithub.com/apache/airflow/issues/28130)) - Make BaseJob.most_recent_job favor "running" jobs ([#28119](https://togithub.com/apache/airflow/issues/28119)) - Don't emit FutureWarning when code not calling old key ([#28109](https://togithub.com/apache/airflow/issues/28109)) - Add `airflow.api.auth.backend.session` to backend sessions in compose ([#28094](https://togithub.com/apache/airflow/issues/28094)) - Resolve false warning about calling conf.get on moved item ([#28075](https://togithub.com/apache/airflow/issues/28075)) - Return list of tasks that will be changed ([#28066](https://togithub.com/apache/airflow/issues/28066)) - Handle bad zip files nicely when parsing DAGs. ([#28011](https://togithub.com/apache/airflow/issues/28011)) - Prevent double loading of providers from local paths ([#27988](https://togithub.com/apache/airflow/issues/27988)) - Fix deadlock when chaining multiple empty mapped tasks ([#27964](https://togithub.com/apache/airflow/issues/27964)) - fix: current_state method on TaskInstance doesn't filter by map_index ([#27898](https://togithub.com/apache/airflow/issues/27898)) - Don't log CLI actions if db not initialized ([#27851](https://togithub.com/apache/airflow/issues/27851)) - Make sure we can get out of a faulty scheduler state ([#27834](https://togithub.com/apache/airflow/issues/27834)) - dagrun, `next_dagruns_to_examine`, add MySQL index hint ([#27821](https://togithub.com/apache/airflow/issues/27821)) - Handle DAG disappearing mid-flight when dag verification happens ([#27720](https://togithub.com/apache/airflow/issues/27720)) - fix: continue checking sla ([#26968](https://togithub.com/apache/airflow/issues/26968)) - Allow generation of connection URI to work when no conn type ([#26765](https://togithub.com/apache/airflow/issues/26765)) Misc/Internal ^^^^^^^^^^^^^ - Remove limit for `dnspython` after eventlet got fixed ([#29004](https://togithub.com/apache/airflow/issues/29004)) - Limit `dnspython` to < `2.3.0` until eventlet incompatibility is solved ([#28962](https://togithub.com/apache/airflow/issues/28962)) - Add automated version replacement in example dag indexes ([#28090](https://togithub.com/apache/airflow/issues/28090)) - Cleanup and do housekeeping with plugin examples ([#28537](https://togithub.com/apache/airflow/issues/28537)) - Limit `SQLAlchemy` to below `2.0` ([#28725](https://togithub.com/apache/airflow/issues/28725)) - Bump `json5` from `1.0.1` to `1.0.2` in `/airflow/www` ([#28715](https://togithub.com/apache/airflow/issues/28715)) - Fix some docs on using sensors with taskflow ([#28708](https://togithub.com/apache/airflow/issues/28708)) - Change Architecture and OperatingSystem classes into `Enums` ([#28627](https://togithub.com/apache/airflow/issues/28627)) - Add doc-strings and small improvement to email util ([#28634](https://togithub.com/apache/airflow/issues/28634)) - Fix `Connection.get_extra` type ([#28594](https://togithub.com/apache/airflow/issues/28594)) - navbar, cap dropdown size, and add scroll bar ([#28561](https://togithub.com/apache/airflow/issues/28561)) - Emit warnings for `conf.get*` from the right source location ([#28543](https://togithub.com/apache/airflow/issues/28543)) - Move MyPY plugins of ours to dev folder ([#28498](https://togithub.com/apache/airflow/issues/28498)) - Add retry to `purge_inactive_dag_warnings` ([#28481](https://togithub.com/apache/airflow/issues/28481)) - Re-enable Plyvel on ARM as it now builds cleanly ([#28443](https://togithub.com/apache/airflow/issues/28443)) - Add SIGUSR2 handler for LocalTaskJob and workers to aid debugging ([#28309](https://togithub.com/apache/airflow/issues/28309)) - Convert `test_task_command` to Pytest and `unquarantine` tests in it ([#28247](https://togithub.com/apache/airflow/issues/28247)) - Make invalid characters exception more readable ([#28181](https://togithub.com/apache/airflow/issues/28181)) - Bump decode-uri-component from `0.2.0` to `0.2.2` in `/airflow/www` ([#28080](https://togithub.com/apache/airflow/issues/28080)) - Use asserts instead of exceptions for executor not started ([#28019](https://togithub.com/apache/airflow/issues/28019)) - Simplify dataset `subgraph` logic ([#27987](https://togithub.com/apache/airflow/issues/27987)) - Order TIs by `map_index` ([#27904](https://togithub.com/apache/airflow/issues/27904)) - Additional info about Segmentation Fault in `LocalTaskJob` ([#27381](https://togithub.com/apache/airflow/issues/27381)) Doc Only Changes ^^^^^^^^^^^^^^^^ - Mention mapped operator in cluster policy doc ([#28885](https://togithub.com/apache/airflow/issues/28885)) - Slightly improve description of Dynamic DAG generation preamble ([#28650](https://togithub.com/apache/airflow/issues/28650)) - Restructure Docs ([#27235](https://togithub.com/apache/airflow/issues/27235)) - Update scheduler docs about low priority tasks ([#28831](https://togithub.com/apache/airflow/issues/28831)) - Clarify that versioned constraints are fixed at release time ([#28762](https://togithub.com/apache/airflow/issues/28762)) - Clarify about docker compose ([#28729](https://togithub.com/apache/airflow/issues/28729)) - Adding an example dag for dynamic task mapping ([#28325](https://togithub.com/apache/airflow/issues/28325)) - Use docker compose v2 command ([#28605](https://togithub.com/apache/airflow/issues/28605)) - Add AIRFLOW_PROJ_DIR to docker-compose example ([#28517](https://togithub.com/apache/airflow/issues/28517)) - Remove outdated Optional Provider Feature outdated documentation ([#28506](https://togithub.com/apache/airflow/issues/28506)) - Add documentation for \[core] mp_start_method config ([#27993](https://togithub.com/apache/airflow/issues/27993)) - Documentation for the LocalTaskJob return code counter ([#27972](https://togithub.com/apache/airflow/issues/27972)) - Note which versions of Python are supported ([#27798](https://togithub.com/apache/airflow/issues/27798))Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by Mend Renovate. View repository job log here.