More generic, installable - Githubissues

Azure-Samples / ai-rag-chat-evaluator

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI

MIT License

226 stars 78 forks source link

More generic, installable #102

Closed pamelafox closed 3 weeks ago

pamelafox commented 2 months ago

Purpose

Re-architected as an installable app, for easier use from other repositories and easier testing.
Made a more generic function for generating ground truth data, to be used with other retrievers (like PostgreSQL)

Does this introduce a breaking change?

[X] Yes - Perhaps, depending on how folks have integrated the tool. But unlikely since it wasn't installable before.
[ ] No

Pull Request Type

What kind of change does this Pull Request introduce?

[ ] Bugfix
[X] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test

Ran all commands in README
Ran tests