Closed kami619 closed 4 months ago
Thank you for suggesting this, I think it is great idea. If we are using dashboard in AWS, they would AFAIK only pull data when we're displaying them, so we should be fine.
If we choose to have a dashboard in Grafana, we would IMHO need to ensure that we use a datasource which pulls the metrics directly from AWS when we need them. If we would first import all data into Prometheus, this would incur the costs even if we don't look at the graph.
I would assume we would start with the default dashboard hosted on AWS?
correct @ahus1 the starting point would be to start off with the AWS dashboard, similar to how we are monitoring the Aurora RDS Cluster using Cloud Watch metrics. This would be an augmentation to our current approach. But its a good point to call out, the cost per metric would be different when we use a metric scraper like Prometheus.
Description
Request to enhance the Aurora DB cluster creation scripts with the option to enable performance insights based on a conditional flag such as
AURORA_PERFORMANCE_INSIGHTS
with the value being a booleantrue/false
.We can achieve this in AWS CLI using a similar command and argument combo
And below is an example for the Terraform resource module
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/rds_cluster_instance#performance_insights_enabled
Optional: While we do this, we could explore if we do this per RDS node, if possible to contain the costs etc., as we might be interested in only the writer nodes or reader nodes based on the load test we perform.
Discussion
No response
Motivation
Enabling performance insights in AWS Aurora RDS nodes, will be beneficial to have on-demand additional performance observability on AWS Aurora instances. It will make the debugging faster to peek at slow queries and specific bottlenecks in the RDS instances.
Below are a couple of screenshots of the Performance Insights metrics from a load test run:
Details
Performance Insights is an advanced database performance monitoring feature that makes it easy to diagnose and solve performance challenges on Amazon RDS databases. It offers a free tier with 7 days of rolling data retention, and a paid long-term data retention option. For more information about Performance Insights, please visit the documentation
Performance Insights offers a rolling seven days of performance data history at no charge. This is enough time to troubleshoot a wide variety of issues. The Performance Insights free tier includes:
As an example, say you create a custom dashboard that makes calls to RDS Performance Insights’ two APIs, DescribeDimensionKeys, and GetResourceMetrics. The dashboard calls these two APIs every 5 seconds. That would be: