Deploy in Container apps job?

Azure-Samples / ai-rag-chat-evaluator

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI

MIT License

163 stars 59 forks source link

Deploy in Container apps job? #3

Open dfberry opened 6 months ago

dfberry commented 6 months ago

Maybe I'm missing where the evaluator gets deployed but would it make sense as a container app job?

@anthonychu

pamelafox commented 5 months ago

I just run it locally, but it could be a good fit for ACA jobs. Not sure if we'd want to parallelize it (chunk up the data) or just run it all. Runs take about an hour on 200-question ground truth data sets.