aws-samples / amazon-bedrock-samples

This repository contains examples for customers to get started using the Amazon Bedrock Service. This contains examples for all available foundational models
https://aws.amazon.com/bedrock/
MIT No Attribution
358 stars 183 forks source link

Adding observability and evaluation project code #205

Open isingh09 opened 2 weeks ago

isingh09 commented 2 weeks ago

Issue #, if available: NA

Description of changes: This Python (and JavaScript) package provides a solution for observability, response evaluation, RAG evaluation, and tracking metadata for Amazon Bedrock applications, including Knowledge Bases, Agents, Invoke Model, Function Calling, and Guardrails. It leverages Amazon Kinesis Firehose to ingest data into an S3 bucket to enable data analysis and visualization using services like Amazon Athena and Amazon QuickSight.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.