microsoft / finops-toolkit

Tools and resources to help you adopt and implement FinOps capabilities that automate and extend the Microsoft Cloud.
https://aka.ms/finops/toolkit
MIT License
307 stars 107 forks source link

[Power BI] tags separation #985

Open saleemmy opened 2 months ago

saleemmy commented 2 months ago

I am unable to seggregate tags into columns and link them in the powerbi model to pull cost per tag

arthurclares commented 2 months ago

@arthursilvany can you help?

arthursilvany commented 2 months ago

@saleemmy I recently created an article in our community about this topic. Check it out at the link: https://techcommunity.microsoft.com/t5/azure-infragurus/passo-a-passo-para-criar-um-filtro-de-tag-no-finops-hub/ba-p/4249215

saleemmy commented 2 months ago

@arthursilvany thanks for the article, but i adapted another methodology. Transform Data--> costdetails-->select tags column-->rightclick-->transform-->JSON-->this will split all tags into columns, each column header is tag name and fill the cells below the tag values. It worked correctly for me. Also I created a csv file with two columns find and replace. All tag names in find column and corrected names in replace column. this also help to normalize and consolidate the tag names to what I need. Similarly I did normalization and consolidation of tag values to find and replace incorrect values with correct values as needed.

flanakin commented 1 month ago

One thought I've had about how to automate this might be to add an array of tags to extract in config, then have the report read from that and extract them as needed. This would support version updates of reports, so you could keep getting the latest without having to customize each report every time you update. Would that help you here?

saleemmy commented 1 month ago

@flanakin that would be a good idea to extract out the tags from the cost report and separately build it as config. I think it would reduce the file size as well make refresh faster.
When you say version updates of the powerbi reports, what changes keep coming up in these reports? If a powerbi report is configured and published, it keeps refreshing and update the dashboards.

flanakin commented 1 month ago

@saleemmy We added a "PromotedTags" step in the CostDetails query in Power BI reports to help with this. We still need to do more to up-level this into a cross-version configuration setting, but hopefully this gives you a stepping stone to easily identify what tags you want to promote to dedicated columns. Does this give you the foundational aspects you're looking for?

AErmie commented 1 month ago

Hey @flanakin, I'm helping a customer implement the FinOps Toolkit, and even though their Subscriptions are tagged, I'm not seeing those tag names / values anywhere within any of the tag-based fields. Should the Subscription tags be included in the ingestion/export?