search

aws-observability / terraform-aws-observability-accelerator

Open source project to help accelerate and ease observability setup on AWS environments
https://aws-observability.github.io/terraform-aws-observability-accelerator/
Apache License 2.0
288 stars 84 forks source link

All working ? but no data in Dashboards #242

Closed awsandy closed 1 year ago

awsandy commented 1 year ago

Hi,

I have deployed the existing-cluster-with-base-and-infra example.

All seems to have deployed ok, deployments/statefulsets and pods are running.

In Grafana the dashboards have arrived and the aws-observability-accelerator "save and test" button says "data source is working" but there is "No data" on any of the dashboards.

Can you suggest any troubleshooting steps for this circumstance?

bonclay7 commented 1 year ago

Check this one out, hope it helps https://aws-observability.github.io/terraform-aws-observability-accelerator/eks/troubleshooting/

awsandy commented 1 year ago

Hi,

Thanks for the pointer - In the end the problem was that the Role associated with my Grafana workspace had no policies attached to it - as soon as I added the "AmazonPrometheusQueryAccess" policy to this role - all the Grafana dashboards came to life.

It might be worth adding this check to the troubleshooting docs ?

Andy

bonclay7 commented 1 year ago

Thanks for coming back and report. Absolutely! would you be up for a docs PR?