search

aws-solutions / qnabot-on-aws

AWS QnABot is a multi-channel, multi-language conversational interface (chatbot) that responds to your customer's questions, answers, and feedback. The solution allows you to deploy a fully functional chatbot across multiple channels including chat, voice, SMS and Amazon Alexa.
https://aws.amazon.com/solutions/implementations/aws-qnabot
Apache License 2.0
401 stars 253 forks source link

Cost and Tokens Metrics in OpenSearch Dashboard #782

Open DiljithNair opened 2 weeks ago

DiljithNair commented 2 weeks ago

Would like to have a metrics in the OpenSearch dashboard of the qnabot to show the cost incurred by the bot in real-time along with the number of tokens (input and output) used by the foundational model used.

A OpenSearch visualization using qnabot logs showing the cost incurred and tokens consumed by the bot to analysts to make data driven decisions and tweaks to the bot.

abhirpat commented 2 weeks ago

Thank you for reporting this @DiljithNair. We will get back to you.