search

NASA-PDS / nucleus

Nucleus is a software platform used to create workflows for the Planetary Data (PDS).
https://nasa-pds.github.io/nucleus
Apache License 2.0
0 stars 0 forks source link

Bump apache-airflow-providers-amazon from 2.4.3 to 7.2.1 in /terraform/terraform-modules/mwaa-env #48

Closed dependabot[bot] closed 1 year ago

dependabot[bot] commented 1 year ago

Bumps apache-airflow-providers-amazon from 2.4.3 to 7.2.1.

Release notes

Sourced from apache-airflow-providers-amazon's releases.

Apache Airflow 2.6.1

Significant Changes

Clarifications of the external Health Check mechanism and using Job classes (#31277).

In the past SchedulerJob and other *Job classes are known to have been used to perform external health checks for Airflow components. Those are, however, Airflow DB ORM related classes. The DB models and database structure of Airflow are considered as internal implementation detail, following public interface <https://airflow.apache.org/docs/apache-airflow/stable/public-airflow-interface.html>_). Therefore, they should not be used for external health checks. Instead, you should use the airflow jobs check CLI command (introduced in Airflow 2.1) for that purpose.

Bug Fixes

  • Fix calculation of health check threshold for SchedulerJob (#31277)
  • Fix timestamp parse failure for k8s executor pod tailing (#31175)
  • Make sure that DAG processor job row has filled value in job_type column (#31182)
  • Fix section name reference for api_client_retry_configuration (#31174)
  • Ensure the KPO runs pod mutation hooks correctly (#31173)
  • Remove worrying log message about redaction from the OpenLineage plugin (#31149)
  • Move interleave_timestamp_parser config to the logging section (#31102)
  • Ensure that we check worker for served logs if no local or remote logs found (#31101)
  • Fix MappedTaskGroup import in taskinstance file (#31100)
  • Format DagBag.dagbag_report() Output (#31095)
  • Mask task attribute on task detail view (#31125)
  • Fix template error when iterating None value and fix params documentation (#31078)
  • Fix apache-hive extra so it installs the correct package (#31068)
  • Fix issue with zip files in DAGs folder when pre-importing Airflow modules (#31061)
  • Move TaskInstanceKey to a separate file to fix circular import (#31033, #31204)
  • Fix deleting DagRuns and TaskInstances that have a note (#30987)
  • Fix airflow providers get command output (#30978)
  • Fix Pool schema in the OpenAPI spec (#30973)
  • Add support for dynamic tasks with template fields that contain pandas.DataFrame (#30943)
  • Use the Task Group explicitly passed to 'partial' if any (#30933)
  • Fix order_by request in list DAG rest api (#30926)
  • Include node height/width in center-on-task logic (#30924)
  • Remove print from dag trigger command (#30921)
  • Improve task group UI in new graph (#30918)
  • Fix mapped states in grid view (#30916)
  • Fix problem with displaying graph (#30765)
  • Fix backfill KeyError when try_number out of sync (#30653)
  • Re-enable clear and setting state in the TaskInstance UI (#30415)
  • Prevent DagRun's state and start_date from being reset when clearing a task in a running DagRun (#30125)

Misc/Internal

  • Upper bind dask until they solve a side effect in their test suite (#31259)
  • Show task instances affected by clearing in a table (#30633)
  • Fix missing models in API documentation (#31021)

Doc only changes

  • Improve description of the dag_processing.processes metric (#30891)

... (truncated)

Changelog

Sourced from apache-airflow-providers-amazon's changelog.

.. Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

.. http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

.. contents:: Apache Airflow Releases :local: :depth: 1

.. towncrier release notes start

Airflow 2.6.1 (2023-05-16)

Significant Changes ^^^^^^^^^^^^^^^^^^^

Clarifications of the external Health Check mechanism and using Job classes (#31277). """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""

In the past SchedulerJob and other *Job classes are known to have been used to perform external health checks for Airflow components. Those are, however, Airflow DB ORM related classes. The DB models and database structure of Airflow are considered as internal implementation detail, following public interface <https://airflow.apache.org/docs/apache-airflow/stable/public-airflow-interface.html>_). Therefore, they should not be used for external health checks. Instead, you should use the airflow jobs check CLI command (introduced in Airflow 2.1) for that purpose.

Bug Fixes ^^^^^^^^^

  • Fix calculation of health check threshold for SchedulerJob (#31277)
  • Fix timestamp parse failure for k8s executor pod tailing (#31175)
  • Make sure that DAG processor job row has filled value in job_type column (#31182)
  • Fix section name reference for api_client_retry_configuration (#31174)
  • Ensure the KPO runs pod mutation hooks correctly (#31173)
  • Remove worrying log message about redaction from the OpenLineage plugin (#31149)
  • Move interleave_timestamp_parser config to the logging section (#31102)
  • Ensure that we check worker for served logs if no local or remote logs found (#31101)
  • Fix MappedTaskGroup import in taskinstance file (#31100)

... (truncated)

Commits


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/NASA-PDS/nucleus/network/alerts).
dependabot[bot] commented 1 year ago

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.

jordanpadams commented 7 months ago

@ramesh-maddegoda can you provide a rationale as to why this is not a concern? thanks!

ramesh-maddegoda commented 7 months ago

@jordanpadams, we are already using the version. 8.18.0.

apache-airflow-providers-amazon==8.18.0

I made this change directly on AWS MWAA requirements.txt file.

This change will be also included in the upcoming terraform changes.