Azure-Samples / contoso-chat

This sample has the full End2End process of creating RAG application with Prompt Flow and AI Studio. It includes GPT 3.5 Turbo LLM application code, evaluations, deployment automation with AZD CLI, GitHub actions for evaluation and deployment and intent mapping for multiple LLM task mapping.
MIT License
366 stars 2.28k forks source link

GitHub Actions Evaluation Updates #107

Closed jldeen closed 1 month ago

jldeen commented 1 month ago

In addition, this pull request updates the evaluation GitHub Workflow. The changes include ensuring the promptflow eval works with 1.11 dev bits, publish those results to GitHub Actions Job Summary report, and updating eval and chat.prompty paths to run from any directory.