search

Snowflake-Labs / OpenLineage-AccessHistory-Setup

Guideline to extract table lineage info in OpenLineage format from access history view
Apache License 2.0
10 stars 5 forks source link

etl_openlineage error: emit only accepts RunEvent class #10

Open Sheeri opened 2 years ago

Sheeri commented 2 years ago

"/home/airflow/.local/lib/python3.7/site-packages/openlineage/client/client.py", line 61, in emit raise ValueError("emit only accepts RunEvent class") ValueError: emit only accepts RunEvent class [2022-06-17, 17:50:29 UTC] {taskinstance.py:1288} INFO - Marking task as FAILED. dag_id=etl_openlineage, task_id=send_ol_events, execution_date=20220617T175013, start_date=20220617T175014, end_date=20220617T175029

Sheeri commented 2 years ago

In a chat with @rossturk:

Ross: my current working hypothesis is that client.emit has gotten pickier somehow since that example was written…we can prove/disprove that by pinning openlineage-airflow in Dockerfile to an older version. we can also include @fm100 who wrote this DAG, he might like to be part of this.

the runevent class check was added three months ago, so this is plausible