Azure-Samples / ai-rag-chat-evaluator

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI
MIT License
163 stars 59 forks source link

Support for making a directory #15

Closed pamelafox closed 5 months ago

pamelafox commented 5 months ago

Purpose

Fixes #9

This PR changes the generate script to make sure the output directory exists. If it doesn't, it creates it.

Does this introduce a breaking change?

[ ] Yes
[X] No

Pull Request Type

What kind of change does this Pull Request introduce?

[ ] Bugfix
[X] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test

Try generate with a non-existent directory:

python3 -m scripts generate --output=example_input2/qa.jsonl --numquestions=2