microsoft / finops-toolkit

Tools and resources to help you adopt and implement FinOps capabilities that automate and extend the Microsoft Cloud.
https://aka.ms/finops/toolkit
MIT License
282 stars 93 forks source link

I would like to import previous years' cost data into the dashboards #515

Open simonarbel opened 9 months ago

simonarbel commented 9 months ago

Any idea how to do that?

flanakin commented 8 months ago

@simonarbel, is this about FinOps hubs? If so, we plan to add data retention and backfill support to get as much data as you want. For now, the simplest option is to update your export to a specific date range and then run it as a one-time export. FinOps toolkit 0.2 will include a PowerShell command that will help with this but you can do it manually in the portal today. We'll also add the auto-backfill support in either 0.3 or 0.4. I'll keep this around as a feature request for now.

simonarbel commented 8 months ago

Hey Michael

Yes this is regarding the Finops hub AFAIK scheduled exporting cost data from the portal is only limited to 3 months back. Is there a way to go back earlier?

I tried to place usage data CSV from previous year in the blob but that didn't work for me.

Simon

Get Outlook for Androidhttps://aka.ms/AAb9ysg


From: Michael Flanakin @.> Sent: Friday, January 19, 2024 12:23:14 PM To: microsoft/finops-toolkit @.> Cc: Simon Arbel @.>; Mention @.> Subject: Re: [microsoft/finops-toolkit] I would like to import previous years' cost data into the dashboards (Issue #515)

@simonarbelhttps://github.com/simonarbel, is this about FinOps hubs? If so, we plan to add data retention and backfill support to get as much data as you want. For now, the simplest option is to update your export to a specific date range and then run it as a one-time export. FinOps toolkit 0.2 will include a PowerShell command that will help with this but you can do it manually in the portal today. We'll also add the auto-backfill support in either 0.3 or 0.4. I'll keep this around as a feature request for now.

— Reply to this email directly, view it on GitHubhttps://github.com/microsoft/finops-toolkit/issues/515#issuecomment-1900136954, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AX4PW7423KXHRBE5RYILOPTYPJCRFAVCNFSM6AAAAABBJW2XTCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMBQGEZTMOJVGQ. You are receiving this because you were mentioned.Message ID: @.***>

flanakin commented 8 months ago

The portal is limited to 3 months, but the API is not. We have an update coming to the Start-FinOpsCostExport PowerShell command that will do this in 0.2.1 and then a backfill feature for 0.3 that will solve it more explicitly.

Start-FinOpsCostExport -Name {export-name} -Scope {scope-id}
simonarbel commented 8 months ago

Thanks so how this API can be used to populate the PBI dashboards? Is there any explanation in the setup guide?

flanakin commented 7 months ago

No, we don't cover this today. I'll keep this issue open to add that to the docs. For now, you can use the Cost Management docs @ https://learn.microsoft.com/azure/cost-management-billing/automate/tutorial-seed-historical-cost-dataset-exports-api.