[Question] Automated Deployment

[Xeroxxx]

Hello, I was trying to use the automated deployment for aws-cost-analysis. Everything went well and all functions are created in lambda.

• However its not clear to me when the athena database is created. There is still not database.
• curprocessor-sam-xAcctStepFunctionStarter is running periodicly
• the billing bucket name is the source of the reports correct?

[concurrencylabs]

Thanks for using this solution. The Athena database is created when a new AWS Cost and Usage report is detected in the S3 bucket. This triggers the Step Function that eventually calls https://github.com/concurrencylabs/aws-cost-analysis/blob/master/functions/create-athena-resources.py Basically, you have to wait until a new report is placed in the S3 bucket. If after that, you still don't see a new Athena table created, please let us know.

[Xeroxxx]

Hello, actually the deployment went well. I specified the destinaton bucket (as report source) etc. Still no athena database created.

Where do I specifiy the source bucket of my aws reports that are being generated daily?

[concurrencylabs]

Just to double check, these should be the steps:

• Create S3 Bucket and Configure Cost and Usage Reports following the instructions in the README file (under "Enable AWS Cost and Usage Reports" section). Make sure the S3 bucket has the right permissions, such that AWS can place the CUR in it (the README has details on that)
• Confirm that reports are generated and placed in the S3 bucket.
• Confirm that BucketName and ReportPathPrefix are set to the right values corresponding to the S3 bucket and prefix, respectively, where CUR are placed by AWS. Make sure ReportPathPrefix ends in "/".

I hope this helps

[Xeroxxx]

Thanks for the follow up. So I cleaned everything up.

AWS_REGION=eu-central-1 BUCKET=billingstore BILLING_BUCKET_NAME=billingreport NAME=curprocessor-sam

ReportPathPrefix=aws/aws-reports/

billingstore contains nothing (after deployment it contains the curprocessor-sam folder for the package) billingreport contains the reports in folder aws/aws-reports/{period}/{csv-file} (gzip)

However do I need to run this in advance? This runs fine: python report_utils.py --action=prepare-athena --source-bucket=billingreport --source-prefix=aws/aws-reports/ --dest-bucket=billingstore --dest-prefix=reports/ --year=2018 --month=7

Thank you so much for support!

[concurrencylabs]

No, no need to run the report_utils.py script. The stack created by curprocessor-xacct-sam.yml is just a way to automate the steps to get CUR converted into an Athena table, so they're ready to be queried. The report_utils.py script is a way to manually trigger those steps.

Basically, they don't depend on each other. I hope this answers your question.