search

Snowflake-Labs / OpenLineage-AccessHistory-Setup

Guideline to extract table lineage info in OpenLineage format from access history view
Apache License 2.0
10 stars 5 forks source link

Pin openlineage python version #11

Open Sheeri opened 2 years ago

Sheeri commented 2 years ago

fixes #10

rossturk commented 2 years ago

FYI - I think this PR contains more changes than just pinning the OpenLineage library, and some of them seem to be overlapping with other PRs.

Pinning OL to 0.6.2 is a good idea, since a) the 0.9.0 client automatically emits job metadata from SnowflakeOperator via TaskListener even when LineageBackend is not configured, causing confusing duplicate metadata; and b) the client.emit call has become more sensitive to its input data since 0.6.2, and the extract DAG no longer works.