Azure-Samples / rag-postgres-openai-python

A RAG app to ask questions about rows in a database table. Deployable on Azure Container Apps with PostgreSQL Flexible Server.
MIT License
263 stars 131 forks source link

Update eval_config.json #112

Closed crazy4pi314 closed 1 month ago

crazy4pi314 commented 1 month ago

Purpose

Does this introduce a breaking change?

When developers merge from main and run the server, azd up, or azd deploy, will this produce an error? If you're not sure, try it out on an old environment.

[ ] Yes
[ ] No

Type of change

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

Code quality checklist

See CONTRIBUTING.md for more details.

crazy4pi314 commented 1 month ago

/evaluate

github-actions[bot] commented 1 month ago

Starting evaluation! Check the Actions tab for progress, or wait for a comment with the results.

github-actions[bot] commented 1 month ago
metric stat baseline pr112
gpt_groundedness mean_rating 5.0 5.0
pass_rate 1.0 1.0
gpt_relevance mean_rating 5.0 5.0
pass_rate 1.0 1.0
answer_length mean 978.9 1106.5
latency mean 2.51 2.16
citation_match rate 1.0 1.0
num_questions total 10 10