Nike-Inc / brickflow

Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
https://engineering.nike.com/brickflow/
Apache License 2.0
183 stars 36 forks source link

Feature/bump plugin dependencies for pydantic 2.x #102

Closed maxim-mityutko closed 5 months ago

maxim-mityutko commented 5 months ago

Closes #95

Description

Bump versions of airflow and snowflake packages to ensure compatibility with libraries that require pydantic >= 2.x.x

Related Issue

95

Motivation and Context

Certain libraries require pydantic >= 2.x, and while brickflow itself is compatible with it, when plugins are enabled the older snowflake and airflow dependencies for pydantic 1.x

How Has This Been Tested?

Built-in tests; bumped library's versions in the real life project and use library that requires pydantic 2.x

Screenshots (if appropriate):

Types of changes

Checklist:

codecov[bot] commented 5 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 90.32%. Comparing base (6ba515b) to head (e2e3e50).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #102 +/- ## ======================================= Coverage 90.32% 90.32% ======================================= Files 22 22 Lines 3381 3381 ======================================= Hits 3054 3054 Misses 327 327 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.