OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
Hey, I am just trying to test openmetadata using docker compose. I managed to set up a service connection to Snowflake. Following this, I tried to create a dbt ingestion. This is where it breaks down. I will post here part of the logs. I went in the source codes here, but I have zero clues what is wrong. It's only parsing our manifest.yml.
[2024-11-04T15:44:18.739+0000] {taskinstance.py:2905} ERROR - Task failed with exception
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.10/site-packages/airflow/models/taskinstance.py", line 465, in _execute_task
result = _execute_callable(context=context, **execute_callable_kwargs)
File "/home/airflow/.local/lib/python3.10/site-packages/airflow/models/taskinstance.py", line 432, in _execute_callable
return execute_callable(context=context, **execute_callable_kwargs)
File "/home/airflow/.local/lib/python3.10/site-packages/airflow/models/baseoperator.py", line 400, in wrapper
return func(self, *args, **kwargs)
File "/home/airflow/.local/lib/python3.10/site-packages/airflow/operators/python.py", line 235, in execute
return_value = self.execute_callable()
File "/home/airflow/.local/lib/python3.10/site-packages/airflow/operators/python.py", line 252, in execute_callable
return self.python_callable(*self.op_args, **self.op_kwargs)
File "/home/airflow/.local/lib/python3.10/site-packages/openmetadata_managed_apis/workflows/ingestion/common.py", line 208, in metadata_ingestion_workflow
workflow.raise_from_status()
File "/home/airflow/.local/lib/python3.10/site-packages/metadata/workflow/workflow_status_mixin.py", line 134, in raise_from_status
raise err
File "/home/airflow/.local/lib/python3.10/site-packages/metadata/workflow/workflow_status_mixin.py", line 131, in raise_from_status
self.raise_from_status_internal(raise_warnings)
File "/home/airflow/.local/lib/python3.10/site-packages/metadata/workflow/ingestion.py", line 163, in raise_from_status_internal
raise WorkflowExecutionError(
metadata.config.common.WorkflowExecutionError: OpenMetadata reported errors: OpenMetadata Summary: [3568 Records, [0 Updated Records, 0 Warnings, 1 Errors, 0 Filtered]
[2024-11-04T15:44:18.751+0000] {common.py:304} INFO - Sending failed status from callback...
[2024-11-04T15:44:18.755+0000] {server_mixin.py:74} INFO - OpenMetadata client running with Server version [1.5.10] and Client version [1.5.10.0]
[2024-11-04T15:44:18.755+0000] {common.py:310} INFO - Sending status to Ingestion Pipeline grouponedata.96e2337a-e8e2-4cdf-a452-bdf8d7a0e9e9
[2024-11-04T15:44:18.864+0000] {standard_task_runner.py:110} ERROR - Failed to execute job 20 for task dbt_task (OpenMetadata reported errors: OpenMetadata Summary: [3568 Records, [0 Updated Records, 0 Warnings, 1 Errors, 0 Filtered]; 14334)
[2024-11-04T15:44:18.929+0000] {local_task_job_runner.py:240} INFO - Task exited with return code 1
[2024-11-04T15:44:18.945+0000] {taskinstance.py:3498} INFO - 0 downstream tasks scheduled from follow-on schedule check
[2024-11-04T15:44:18.954+0000] {local_task_job_runner.py:222} INFO - ::endgroup::
Hey, I am just trying to test openmetadata using docker compose. I managed to set up a service connection to Snowflake. Following this, I tried to create a dbt ingestion. This is where it breaks down. I will post here part of the logs. I went in the source codes here, but I have zero clues what is wrong. It's only parsing our manifest.yml.