Monitoring and alarms, or observability in general

aws / copilot-cli

The AWS Copilot CLI is a tool for developers to build, release and operate production ready containerized applications on AWS App Runner or Amazon ECS on AWS Fargate.

https://aws.github.io/copilot-cli/

Apache License 2.0

3.48k stars 401 forks source link

Monitoring and alarms, or observability in general #2401

Open Fodoj opened 3 years ago

Fodoj commented 3 years ago

I don't have a concrete proposal, but I also didn't find any existing discussion on this topic: out of the box monitoring and alarms. Currently there is nothing - I suppose the approach would be to create CW Alarms via Addons. Would be cool to have some basic dashboard with performance metrics (RPM, error rates etc), plus some Alarms with SNS out of the box.

reyreaud-l commented 3 years ago

Just to add on that, I would find it extremely useful if we could specify an SNS topics for cloudwatch alarm. That way one can easily integrate further (have aws chatbot sub to the SNS topics or anything else).

efekarakus commented 3 years ago

Hi @reyreaud-l ! Thanks for the additional data point 👍 Would you mind describing your setup to us 🙏

if we could specify an SNS topics for cloudwatch alarm.

How are you defining the CloudWatch alarms today? are you using the "addons/" feature or defining them in another way?

Would you want Copilot to create a single SNS topic for all alarms or one topic/alarm?

reyreaud-l commented 3 years ago

The goal of my (small) setup is to receive all alerts on slack. I don't open the cloudwatch dashboard often so it is better for me to get alerted.

I do that by sending all cloudwatch alarm to an SNS topic and having aws chatbot subscribe to it and forward the alarm to slack.

So for me one topic is sufficient for all alarms, but I also see the flexibility of having different one for other people.

Right now I do it with terraform because I have some left over configuration there from before I switched deployment to copilot. In the future I'll probably move it to the addons folder and CF to integrate better.

efekarakus commented 3 years ago

Awesome thanks this totally makes sense!

huanjani commented 1 year ago

@Fodoj, @reyreaud-l & others: We are actively working on Copilot's monitoring story!

We'd love to hear more details:

which namespaces/metrics do your alarms monitor?
how much fine-tuning do you do for your alarms?
would you want to view dashboards in your terminal or just create them via Copilot then view them in the CloudWatch console?
is cost an issue or is it easy to stay within the free tier?

Thanks for your input!