Status of testing Providers that were prepared on July 02, 2024

[potiuk]

I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers?

The guidelines on how to test providers can be found in

Verify providers by contributors

Let us know in the comment, whether the issue is addressed.

Those are providers that require testing as there were some substantial changes introduced:

Provider openlineage: 1.9.0rc2

• [x] local task job: add overtime mechanism, to not kill task prematurely when auxiliary processes are running (#39890): @mobuchowski
• [x] openlineage: add some debug logging around sql parser call sites (#40200): @mobuchowski
• [x] openlineage: Add task SLA and queued datetime to AirflowRunFacet (#40091): @kacpermuda
• [x] [openlineage] Add error stacktrace to task fail event (#39813): @kacpermuda Linked issues:
  • [x] Linked Issue #38155: @vandonr
• [x] [OPENLINEAGE] Introduce AirflowJobFacet and AirflowStateRunFacet (#39520): @kacpermuda Linked issues:
  • [x] Linked Issue #39467: @kacpermuda
• [x] Use UUIDv7 for OpenLineage runIds (#39889): @dolfinus
• [x] openlineage: isolate metadata extraction by executing OL methods in separate, forked process (#40078): @mobuchowski
• [x] openlineage: readd few removed Task properties in AirflowRunFacet (#40371): @mobuchowski
• [x] openlineage, redshift: do not call DB for schemas below Airflow 2.10 (#40197): @mobuchowski
• [x] openlineage: fix scheduler crashing on airflow standalone (#40459): @kacpermuda Linked issues:
  • [x] Linked Issue #40403: @kacpermuda
• [x] openlineage: nit: fix logging level (#40461): @kacpermuda Linked issues:
  • [x] Linked Issue #40078: @mobuchowski
• [x] openlineage: provide stack trace under proper key in error facet (#40372): @kacpermuda Linked issues:
  • [x] Linked Issue #39813: @kacpermuda
• [x] fix: sqa deprecations for airflow providers (#39293): @dondaum Linked issues:
  • [x] Linked Issue #28723: @potiuk
• [x] Enable enforcing pydocstyle rule D213 in ruff. (#40448): @ferruzzi

All users involved in the PRs: @dondaum @dolfinus @kacpermuda @mobuchowski @ferruzzi

[kacpermuda]

Thanks for the rc2, I'll look into it tomorrow and confirm all the PR's included.

[kacpermuda]

I've run a couple of different DAGs on different environments (standalone, breeze, Astro) and it looks like all the changes work as expected.

[dondaum]

39293 is good.

[kacpermuda]

OpenLineage provider 1.9.0 has been released 🎉

[potiuk]

Indeed!

Thank you everyone. Providers are released.

I invite everyone to help improve providers for the next release, a list of open issues can be found here.