microsoft / finops-toolkit

Tools and resources to help you adopt and implement FinOps capabilities that automate and extend the Microsoft Cloud.
https://aka.ms/finops/toolkit
MIT License
306 stars 106 forks source link

FOCUS - An error occurred in the ‘ftk_LoadData’ query. Expression.Error: We cannot convert the value null to type Table #1083

Open NavidKhan8 opened 3 weeks ago

NavidKhan8 commented 3 weeks ago

We are trying to setup FOCUS PB report using the link https://microsoft.github.io/finops-toolkit/power-bi/focus FinOps Hub setup completed and .parquet data export conversion completed. From Ingestion setting.json hub version is 0.6

We are able to setup cost summary report but facing issue with FOCUS report.

Error: An error occurred in the ‘ftk_LoadData’ query. Expression.Error: We cannot convert the value null to type Table. Details: Value= Type=[Type]

There is note mentioned under FOCUS report setup as below As of FinOps toolkit 0.2, the FOCUS report was merged into the Cost summary report. Both Cost summary and Rate optimization (was Commitment discounts) reports now use FOCUS 1.0 preview. If you would like to use the FOCUS report, you can download it from the FinOps toolkit 0.1.1 release.

Is FOCUS report to be used or should we just use Cost summary report? Tried 0.1.1 release of FOCUS and still an error.

Kindly check and confirm.

arthurclares commented 2 weeks ago

@NavidKhan8 The FOCUS dashboard is only required if you're deploying an early version of Hubs (0.2.1 or 0.1). Any newer version works with FOCUS exports by default. You can deploy any of these dashboards: Cost Summary, Rate Optimization, Workload Optimization or Governance. https://microsoft.github.io/finops-toolkit/power-bi/cost-summary I'll open a PR to update the documentation for better clarity.

NavidKhan8 commented 2 weeks ago

@NavidKhan8 The FOCUS dashboard is only required if you're deploying an early version of Hubs (0.2.1 or 0.1). Any newer version works with FOCUS exports by default. You can deploy any of these dashboards: Cost Summary, Rate Optimization, Workload Optimization or Governance. https://microsoft.github.io/finops-toolkit/power-bi/cost-summary I'll open a PR to update the documentation for better clarity.

Thank you for the clarification. Since we are deploying a newer version of Hubs, we will proceed with the FOCUS exports as they are supported by default. We will also consider deploying the Cost Summary and Rate Optimization dashboards as recommended.

Also one observation, Cost summary report didn't work for me using FinOps hub as data source but worked for my colleague and later found my colleague was running latest Power Bi Desktop version 2.137.1102.0 and I had not so older version but still failed. After installing latest Power Bi Desktop version I'm able to connect & load from FinOps hub datasource data to cost summary report.

NavidKhan8 commented 2 weeks ago

@arthurclares - Additionally, it would be helpful to include details about the time it takes to load large datasets using Power BI Desktop. For instance, loading 2 GB of data from the FinOps hub data source can take up to 4 hours. I selected a start date of the last 6 months with no end date. Therefore, you might consider updating the documentation to provide steps on how to initially load a smaller dataset, publish it to the workspace, and then update the date range to the last 6 months. Performing a data refresh in the Power BI workspace is significantly faster than doing it locally.

arthurclares commented 2 weeks ago

@NavidKhan8 The FOCUS dashboard is only required if you're deploying an early version of Hubs (0.2.1 or 0.1). Any newer version works with FOCUS exports by default. You can deploy any of these dashboards: Cost Summary, Rate Optimization, Workload Optimization or Governance. https://microsoft.github.io/finops-toolkit/power-bi/cost-summary I'll open a PR to update the documentation for better clarity.

Thank you for the clarification. Since we are deploying a newer version of Hubs, we will proceed with the FOCUS exports as they are supported by default. We will also consider deploying the Cost Summary and Rate Optimization dashboards as recommended.

Also one observation, Cost summary report didn't work for me using FinOps hub as data source but worked for my colleague and later found my colleague was running latest Power Bi Desktop version 2.137.1102.0 and I had not so older version but still failed. After installing latest Power Bi Desktop version I'm able to connect & load from FinOps hub datasource data to cost summary report.

@NavidKhan8 Do you happen to have the exact error code you received? It would be good to document it.