microsoft / azure-data-manager-for-energy-power-bi-connector

Microsoft Azure Data Manager for Energy Certified Power BI Connector
MIT License
8 stars 2 forks source link

Data ingested into ADME via Synapse Full data load with Power BI #28

Open kevbor opened 1 year ago

kevbor commented 1 year ago

Hi, I have ingested binary data into ADME via synapse using the following guide (https://github.com/EirikHaughom/ADME/blob/main/Guides/Synapse/DataLakeIngestion/deploy-mi.md) . I have ingested both CSV and JSON files into our ADME instance and validated that I can retrieve the data using a CURL function and the corresponding pipeline run ID as listed in the validation portion of the document above.

While connecting to our ADME instance via Power BI, i noticed that we can only see one record on the ingested dataset, however while ingesting a data via postman we can see all records. Do you have an idea how we can see the full dataset in PowerBI after ingesting the data into ADME with Synapse?

Thanks!

Miller-Kyle commented 1 year ago

Hi @kevbor - can you please include some screenshots? When the data comes back what does the table look like?

kevbor commented 1 year ago

Hi @Miller-Kyle

I have added screenshots here

Source CSV

CSV Input file in Blob Storage (image 1 of 5)

Pipeline Success with run ID number

Synapse Pipeline succeed with ID No (Image 2 of 5)

ADME response with CURL function as seen in the validation segment of the guide in the original post

ADME Response with CURL function in Bash, found in the validation section of the document (image 3 of 5)

Power BI, shows we have the same record ID as in synapse

Power BI same record ID as shown in screenshot 2 (image 4 of 5)

Results in Power BI when expanding the data

Power BI results with expanding the data (image 5 of 5)