aws-samples / aws-batch-operational-dashboards

https://aws.amazon.com/batch/
MIT No Attribution
11 stars 1 forks source link

Cost Dashboard Instructions #17

Open haorasu opened 8 months ago

haorasu commented 8 months ago

The instructions for the Cost Dashboard is slightly off as there are no data sources in the json file that references Cloudwatch.

This is what I see: Screenshot 2023-11-08 at 12 17 38 PM

haorasu commented 8 months ago

Potentially related issue Post deployment of the above:

Error updating options: error querying the database: TABLE_NOT_FOUND: line 1:40: Table 'aws-batch-jobs-data.default.awsbatchcostreport' does not exist

mhuguesaws commented 8 months ago

Will address before end of year.

mhuguesaws commented 4 months ago

Looking at end of Q1 2024.

iMilad commented 2 months ago

any update on this? I get the same data sources and issue as OP mentioned.

mhuguesaws commented 2 months ago

Updated. Let me know if anything else is missing.

iMilad commented 2 months ago

now I get this error, Status: 500. Message: COLUMN_NOT_FOUND: line 1:40: Column 'resource_tags_user_project' cannot be resolved or requester is not authorized to access requested resources any hint? checked the athenacurcfn_a_w_s_batch_cost_report.awsbatchcostreport and there is not such a column image

mhuguesaws commented 2 months ago

It will take 24 hours to populate the CUR as per documentation.

iMilad commented 2 months ago

I am still getting the same error! here is the Athena Cost Data Source image

I checked also Glue table and there is no such a column in its schema, should we follow any instruction when we create batch?

iMilad commented 2 months ago

any hint?

iMilad commented 1 month ago

how this tag "resource_tags_user_project" will be generated? or which service should have this tag? Batch job? we have Batch which is used by different team and we want to understand cost of batch per team.

mhuguesaws commented 1 month ago

This a tag in the batch job

Tag Name: project Tag Value: XXXX

iMilad commented 1 month ago

No, this is not working, I added the tag as you mentioned to the job but still after two days there is no such a column in awsbatchcostreport.

image

cyberchip-wang commented 1 month ago

Have you activated the tag (after you run a job with the tag) under Billing and Cost Management ->Cost Allocation Tags after that? image

After activation, you should see the column in CUR in another day or so.

iMilad commented 1 month ago

thank you, I think in the end it worth to mention in the README.

mhuguesaws commented 1 month ago

@iMilad did it solve your issue?

iMilad commented 1 month ago

yes, this issue is resolved. thanks!

mhuguesaws commented 1 month ago

Will add to the doc.