search

coreylane / slackrock

Conversational AI assistant powered by Amazon Bedrock
MIT License
8 stars 0 forks source link

Feature: Publish custom cloudwatch metrics for usage #15

Open coreylane opened 3 months ago

thap2331 commented 3 weeks ago

I loved this slackrock and been using it for a while. Now I am thinking about collecting metrics more methodologically and I came here to add an issue about it. It looks like we can generate dashboards in cloudwatch based on query, however I would like to hear how you have thought about it. I can try to implement it!

What I would like to know is: 1. How many users are there for a given time period. 2. How many of them are able to get the answers they wanted (this could be a hard one).

coreylane commented 3 weeks ago

Hi Suraj, one approach I was thinking about was implementing structured logs with aws lambda powertools, so you would be able to create custom metrics based on the application log messages and all the metadata sent with each log event.

  1. Custom cloudwatch log metric filter that counts unique user ids in the app logs
  2. This one is a bit more unique, would need to think about this more
thap2331 commented 3 weeks ago

Oh wow! Thank you. I have not used powertools, yet! Let me implement this on my sandbox!