MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.25k stars 21.41k forks source link

Example Currently Broken due to Power BI bug #10205

Closed deldrid1 closed 5 years ago

deldrid1 commented 6 years ago

See https://community.powerbi.com/t5/Desktop/PowerBI-changes-data-table-name-to-RealTimeData-and-creates/td-p/152268 - basically, unless the table name is "RealTimeData" in the streaming analytics output, this doesn't work today.

Also, I was unaware that PowerBi didn't like nested data structures and just imported them as Text... Might be worth adding a note to clarify that you must use a flat data structure if you are using a real device.


Document Details

Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

BryanTrach-MSFT commented 6 years ago

@deldrid1 Thanks for the feedback! We are currently investigating and will update you shortly.

msebolt commented 6 years ago

@dominicbetts Hi Dominic, I think this issue is for one of your articles.

dominicbetts commented 6 years ago

@rangv - Hi Ranga - this issue is for one of your articles. @sergaz-msft - can you reassign this please?

xsqian commented 6 years ago

in this step https://docs.microsoft.com/en-us/azure/iot-hub/iot-hub-live-data-visualization-in-power-bi#add-an-output-to-the-stream-analytics-job after authorization, the save button is still greyed out so I can't save the output.

xsqian commented 6 years ago

however, I tried to use the different type of output, like Blob storage or Table storage, it worked fine.

ahmedhafeez commented 6 years ago

Dataset is not showing in the PowerBi dataset list. Dataset was created in the the step which creates Output for Streaming Analytics. This has been checked for login credentials and for the path to My workspace. Any Suggestion please!

RDSimmons01 commented 6 years ago

Same problem...streaming dataset is not showing in PowerBI.

busch commented 5 years ago

Same here. Streaming dataset not showing in PowerBI

JimacoMS3 commented 5 years ago

@deldrid1, @xsqian, @ahmedhafeez, @RDSimmons01, @Busch -- Thanks for reporting these issues. We've updated the topic and the product has undergone some upgrades as well. The tutorial should work as-advertised now. Please have a look and let us know if we can close this issue.

@deldrid1 -- thanks for your suggestion about adding a note wrt flat data structures. We may not add this at this time, but will monitor the topic and make a note in case of future revisions.

robinsh commented 5 years ago

reassign:jimacoms3

JimacoMS3 commented 5 years ago

@deldrid1, @xsqian, @ahmedhafeez, @RDSimmons01, @Busch Thanks again for reporting these issues. Since we haven't heard back from you, we are going to close this issue. Please feel free to re-open it if you feel the problem you reported hasn't been adequately addressed.

JimacoMS3 commented 5 years ago

please-close

Ardutec commented 5 years ago

Same Error. every thing is okay on IoT hub and job side but Streaming dataset is not showing in PowerBI

JimacoMS3 commented 5 years ago

Hi @Ardutec, I'm not having any trouble running this. I'm using a dataset named ContosoSampleHubTelemetry and a data table named TelemetryData. Everything seems to work fine.

Capture

I think we need to figure out what is different in our scenarios. Can you tell me:

  1. Are you using Power BI online or the desktop app? (I'm using online)
  2. What device you are using to send data? (I would suggest trying the Raspberry Pi Online Simulator as a sanity check).
  3. Have you verified that data is actually arriving at your hub? You can use the az iot hub monitor-events CLI command for this.
  4. When you say everything is OK on IoT hub and job side -- do you mean that the job starts and gets to the running state with no errors? Or?
  5. When you say that the Streaming dataset is not showing in PowerBI. Do you mean that data is not showing up or that you cannot select the dataset to configure a line chart?

I'm not really sure that these are going to make a difference. I'm just trying to narrow down the differences between our scenarios.

Thanks,

Jimaco

Ardutec commented 5 years ago

What subscription model you are using? I am using free tier subscription, I think that may be difference.

  1. I tried both desktop app and Power BI online.
  2. I am using IIOT gateway but that is sending data on IoT hub.
  3. NO I am not able to see in CLI monitoring.
  4. Yes
  5. Nothing change on Power BI, I couldn't find any data set or any other thing from Iot hub side.
JimacoMS3 commented 5 years ago

I'm using a standard (S1) tier hub. The Free tier could be an issue if you have exceeded the 8k/day message limit: https://azure.microsoft.com/en-us/pricing/details/iot-hub/ ; otherwise, I don't think that is the problem.

Your answer to question 3 points to a potential issue. How are you verifying that you are actually getting messages from your gateway to your IoT hub? You should be able to see these with the az iot hub monitor-events command. Specifically, in the tutorial you create a consumer group so you should be able to do the following:

az iot hub monitor-events --hub-name {yourHubname} --cg {yourConsumerGroup} 

Note: You may have to add the -g parameter to specify your hub's resource group. You can also use other parameters to format output and/or filter for a device.

Another potential issue is if you have custom routes created on your IoT hub -- for example to route every message received to storage. If that is the case, the custom route will suck the data before it ever hits the built-in endpoint, so you need to add a compensatory route to make sure the data also gets sent to the built-in endpoint.

Can you also try using the Raspberry Pi online simulator that I pointed you to in question 2 above? This might help narrow down the problem.

JimacoMS3 commented 5 years ago

HI @Ardutec, let me know if any of the above helped.

asergaz commented 5 years ago

@Ardutec please feel free to open a new issue and reference this one if you are still blocked. Thanks!