aws-samples / aws-cudos-framework-deployment

Command Line Interface tool for Cloud Intelligence Dashboards deployment
https://catalog.workshops.aws/awscid
MIT No Attribution
412 stars 167 forks source link

Allow HOURLY granularity #962

Open iakov-aws opened 1 month ago

iakov-aws commented 1 month ago

Some customer have a big CUR. To improve performance we suggest a workaround to change time granularity to daily to reduce 24 times the volume of data.

TimeUnit: HOURLY

Need to update legacy and data collection:

Make sure to:

Current workaround: Granularity can be changed added manually after deployment (and before backfill). Or (preferably) by changing the code before deployment.

- TimeUnit: HOURLY
+ TimeUnit: DAILY
yprikhodko commented 1 month ago

++ include explanation in the doc the change process from hourly to daily:

  1. Delete current stack in payer account (Update of the stack won't work as TimeUnit is a Replacement parameter and replacement CloudFormation cannot update a stack when a custom-named resource requires replacing. Rename cid and update
  2. Delete S3 bucket with current hourly CUR in payer account
  3. Delete hourly data in S3 bucket in data collection account
  4. Deploy https://github.com/aws-samples/aws-cudos-framework-deployment/blob/main/cfn-templates/cur-aggregation.yaml stack in payer account and choose Daily as parameter
  5. Request backfill of the new CUR via support case
iakov-aws commented 1 month ago

So basically we need to remove and create the stacks in both source and destination accounts with full bucket removal. This is quite an update 😓 .

yprikhodko commented 1 month ago

No need to re-deploy stack in destination account, only data cleanup to delete/backup old hourly data