open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.6k stars 1.05k forks source link

Unable to Retrieve .pbit Files for PowerBI Dashboards #18600

Closed migueldcferreira closed 3 days ago

migueldcferreira commented 1 week ago

Affected module Ingestion Framework

Describe the bug We are having trouble retrieving .pbit files for the PowerBI Dashboards Service. We configured Azure to get these files to maintain the lineage between database tables and dashboards. However, we cannot find these .pbit files in the specified directory.

Error message [2024-11-11T11:44:13.010+0000] {base.py:133} WARNING - Error trying to close the step <metadata.ingestion.source.dashboard.powerbi.metadata.PowerbiSource object at 0x7fb4b105b970> due to [[Errno 2] No such file or directory: '/tmp/pbitFiles']

Even if we try to change the directory, we get this error : [2024-11-07T17:29:49.352+0000] {status.py:91} WARNING - Error to yield datamodel lineage details for DB service name [test_postgreSQL]: Error fetching .pbit files from Azure: [Errno 13] Permission denied: '/tmpp'

To Reproduce

  1. Create a Power BI report using data from database tables (e.g., PostgreSQL tables in our tests) and save it as a .pbit file. Publish the report and upload the .pbit file to an Azure Data Lake bucket.
  2. Set up a Power BI dashboard service on OpenMetaData to retrieve the report metadata, including the Azure Data Lake bucket information where the .pbit files are stored.
  3. Test the ingestion process and check if the lineage is correctly established.

Expected behavior Get the lineage between our dashboard model and our postgreSQL tables

Version:

ulixius9 commented 1 week ago

@migueldcferreira would need more information here can you please open a thread on https://slack.open-metadata.org/

I suspect that some configuration might be missing

migueldcferreira commented 1 week ago

Thank you @ulixius9, message sent on #support