hystax / optscale

FinOps and cloud cost optimization tool. Supports AWS, Azure, GCP, Alibaba Cloud and Kubernetes.
https://hystax.com
Apache License 2.0
1.11k stars 156 forks source link

Unable to Configure Cost and Usage Report (CUR) 2.0 #319

Open josepheichers95 opened 3 weeks ago

josepheichers95 commented 3 weeks ago

Hi,

You have provided the steps for the cost and usage report and how to set up, create, and connect it. I need to configure or set up CUR 2.0 and access that data. I have taken the steps, but I am facing an error: Unable to configure a billing report: Unable to find report with required configuration.

I have a doubt: can we set up both CUR reports in one bucket, or do we need to create separate configurations? Can you give me the steps to configure the CUR 2.0 and set it up correctly?

josepheichers95 commented 1 week ago

Hi @maxb-hystax, could you please provide the solution to my issue with configuring CUR 2.0? I'm encountering an error ('Unable to find report with required configuration') and need assistance. Thank you!

tm-hystax commented 1 day ago

Hello! Depending on what you need, use one of the instructions below.

Migrate CUR to CUR 2.0 (using an existing bucket)

Use this case if you have already connected an AWS Data Source (on CUR schema) and want to configure CUR 2.0 data into the same bucket.

1. Create a new Data Export with CUR 2.0 schema. Open the Data Exports page in the AWS Cloud Console.

Set the Export type as "Standard data export" and specify an "Export name". The content of the "Export name"

field will be required when updating an AWS data source in your OptScale account.

image

In the Data table content settings section select the "CUR 2.0" data table and switch on the “Include resource IDs“

in the Additional export content.

image

Select an existing bucket in the Data export storage settings section.

image

Input NEW S3 path prefix

2. Click on the existing AWS data source on the Data Source page. The page with detailed information opens.

Click the UPDATE CREDENTIALS button to update the Data Source credentials. Switch on Update Cost & Usage Report parameters

to update info about the billing bucket.

image

Update "Report name" and "Report path prefix", save and wait for a new report to import!

Migrate CUR to CUR 2.0 (using a new bucket)

Use this option if you have connected an AWS data source and want to edit billing data in the CUR 2.0 schema within a new bucket.

1. Create a new Data Export with CUR 2.0 schema. Open the Data Exports page in the AWS Cloud Console.

Set the Export type as "Standard data export" and specify an "Export name". The content of the "Export name"

field will be required when updating an AWS data source in your OptScale account. image

In the Data table content settings section select the "CUR 2.0" data table and switch on the “Include resource IDs“

in the Additional export content.

image

Configure a new bucket in the Data export storage settings section. The content of the "S3 path prefix" and "S3 bucket name"

fields will be required when updating an AWS data source in your OptScale account. image

2. Click on the existing AWS data source on the Data Source page. The page with detailed information opens.

Click the UPDATE CREDENTIALS button to update the Data Source credentials. Switch on Update Cost & Usage Report parameters

to update info about the billing bucket. image

Enter "Export name" from the first step as "Report name", "S3 bucket name"

as "Report Amazon S3 bucket name", and "S3 bucket name" as "Report path prefix".

Save and wait for a new report to import!

Setting up export in CUR 2.0 format and connect AWS Data Source to OptScale

1. Create a new Data Export with CUR 2.0 schema. Open the Data Exports page in the AWS Cloud Console.

Set the Export type as "Standard data export" and specify an "Export name". The content of the "Export name"

field will be required when tracking a new AWS data source in your OptScale account.

image

In the Data table content settings section select the "CUR 2.0" data table and switch on the “Include resource IDs“

in the Additional export content. image

Configure a new bucket in the Data export storage settings section. The content of the "S3 path prefix" and

"S3 bucket name" fields will be required when tracking a new AWS data source in your account.

image

2. To track a new AWS data source in your OptScale account, please select the AWS Root Account tab at the Data Source Connection step during the initial configuration or later on in the Settings section of the main page. Switch off Automatically detect existing Cost & Usage Report.

root_account_cur2

Enter "Export name" from the first step as "Report name", "S3 bucket name" as "Report Amazon S3 bucket name", and "S3 bucket name" as "Report path prefix".

"Connect" to the Data Source.

josepheichers95 commented 9 hours ago

@tm-hystax -The billing report configuration issue persists despite following the steps correctly. Screenshots provided below for reference and can you provide detailed documentation Screenshot from 2024-07-17 13-38-33 Screenshot from 2024-07-17 13-38-05 Screenshot from 2024-07-17 13-38-21 Screenshot from 2024-07-17 14-27-21

tm-hystax commented 7 hours ago

@josepheichers95, when connecting the data source, you select the checkbox "Automatically detect existing Cost & Usage Report", which currently searches for reports in CUR 1.0. This needs some reworking on our part.

You need to repeat the following steps: into OptScale 1) Deselect "Automatically detect existing Cost & Usage Report" 2) Select "Connect only to data in bucket" 3) Enter your bucket and Data Export information (from your screens):

help