Azure-Samples / ai-rag-chat-evaluator

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI
MIT License
162 stars 58 forks source link

Better debugging for evaluate command #69

Closed pamelafox closed 2 months ago

pamelafox commented 2 months ago

Purpose

This PR adds a specific error message for endpoints that aren't returning JSON, as I suspect that's a common cause of issues. This PR also uses rich for logging output, which is very nice.

Before:

Screenshot 2024-04-08 at 1 10 55 PM

After: Screenshot 2024-04-08 at 1 17 14 PM

Does this introduce a breaking change?

[ ] Yes
[X] No

Pull Request Type

What kind of change does this Pull Request introduce?

[X] Bugfix
[ ] Feature
[X] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test