Azure-Samples / ai-rag-chat-evaluator

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI
MIT License
226 stars 78 forks source link

Add optional target URL to evaluate command and CI to test evaluate #72

Closed pamelafox closed 7 months ago

pamelafox commented 7 months ago

Purpose

This PR adds an optional target URL to the evaluate command and uses that in a CI which tests the evaluate flow.

Does this introduce a breaking change?

[ ] Yes
[X] No

Pull Request Type

What kind of change does this Pull Request introduce?

[ ] Bugfix
[X] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test