Azure-Samples / contoso-chat

This sample has the full End2End process of creating RAG application with Prompty and AI Studio. It includes GPT 3.5 Turbo LLM application code, evaluations, deployment automation with AZD CLI, GitHub actions for evaluation and deployment and intent mapping for multiple LLM task mapping.
MIT License
468 stars 2.88k forks source link

Create evals for built-in performance and quality metrics #188

Closed aprilspeight closed 1 month ago

aprilspeight commented 1 month ago

Comments have been added to the file to indicate some of the changes and areas of opportunity for improvement.

These are the files I added:

File names can be changed. I went with what I felt would differentiate these from the other evaluations.