300Geeks / aws-elk-billing

Tools for Loading and Visualising AWS Detailed Billing with ELK(Elasticsearch, Logstash, Kibana)
MIT License
157 stars 26 forks source link

Can't fetch report files #20

Open AndreStemmann opened 7 years ago

AndreStemmann commented 7 years ago

Hi, thanks for your great work :) Currently Iam facing the issue, that Iam not able to fetch the billing reports. Error-Message says: {noformat} aws-elk-billing_1 | I could not find any billing report under Bucket billing under Path /billing {noformat} I've already tried to strip the Report path from "/" over "/billing" to "/billing/" Anyhow, nothing of this seems to work. Do you have a idea how to fix this? The reports are stored directly within the bucket called "billing".

Thanks in advance!

droidlabour commented 7 years ago

Can you provide listing of your bucket's root dir?

AndreStemmann commented 7 years ago

Hi, below you'll find the listing for the folder called "billing" {noformat} aws-programmatic-access-test-obkect 123456789123-aws-cost-allocation-2017-06.csv 123456789123-aws-cost-allocation-2017-05.csv 123456789123-aws-cost-allocation-2017-04.csv 123456789123-aws-cost-allocation-2017-03.csv 123456789123-aws-cost-allocation-2017-02.csv 123456789123-aws-cost-allocation-2017-01.csv 123456789123-aws-cost-allocation-2016-12.csv 123456789123-aws-cost-allocation-2016-11.csv 123456789123-aws-cost-allocation-2016-10.csv 123456789123-aws-cost-allocation-2016-09.csv 123456789123-aws-cost-allocation-2016-08.csv 123456789123-aws-cost-allocation-2016-07.csv 123456789123-aws-cost-allocation-2016-06.csv 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2017-06.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2017-05.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2017-04.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2017-03.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2017-02.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2017-01.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2016-12.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2016-11.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2016-10.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2016-09.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2016-08.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2016-07.csv.zip 123456789123-aws-billing-detailed-line-items-with-ressources-and-tags-2016-06.csv.zip 123456789123-aws-billing-detailed-line-items-2017-06.csv.zip 123456789123-aws-billing-detailed-line-items-2017-05.csv.zip 123456789123-aws-billing-detailed-line-items-2017-04.csv.zip 123456789123-aws-billing-detailed-line-items-2017-03.csv.zip 123456789123-aws-billing-detailed-line-items-2017-02.csv.zip 123456789123-aws-billing-detailed-line-items-2017-01.csv.zip 123456789123-aws-billing-detailed-line-items-2016-12.csv.zip 123456789123-aws-billing-detailed-line-items-2016-11.csv.zip 123456789123-aws-billing-detailed-line-items-2016-10.csv.zip 123456789123-aws-billing-detailed-line-items-2016-09.csv.zip 123456789123-aws-billing-detailed-line-items-2016-08.csv.zip 123456789123-aws-billing-detailed-line-items-2016-07.csv.zip 123456789123-aws-billing-detailed-line-items-2016-06.csv.zip 123456789123-aws-billing-csv-2017-06.csv 123456789123-aws-billing-csv-2017-05.csv 123456789123-aws-billing-csv-2017-04.csv 123456789123-aws-billing-csv-2017-03.csv 123456789123-aws-billing-csv-2017-02.csv 123456789123-aws-billing-csv-2017-01.csv 123456789123-aws-billing-csv-2016-12.csv 123456789123-aws-billing-csv-2016-11.csv 123456789123-aws-billing-csv-2016-10.csv 123456789123-aws-billing-csv-2016-09.csv 123456789123-aws-billing-csv-2016-08.csv 123456789123-aws-billing-csv-2016-07.csv 123456789123-aws-billing-csv-2016-07.csv {noformat}

Thx in advance!

droidlabour commented 7 years ago

Looks like you've not configured your reports to produce Cost and Usage Reports The directory structure would've been <report-prefix>/<report-name>/yyyymmdd-yyyymmdd/<assemblyId>/<report-name>-<file-number>.csv.<zip|gz> More Info: http://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/billing-reports-costusage-files.html

AndreStemmann commented 7 years ago

Superb! Many thanks for your quick reply. I'll going to test this.

Kind regards A.S.