Canner / WrenAI

🚀 An open-source SQL AI (Text-to-SQL) Agent that empowers data, product teams to chat with their data. 🤘
https://getwren.ai/oss
GNU Affero General Public License v3.0
2.04k stars 211 forks source link

fix(wren-ai-service): error handling for evaluation process #561

Closed paopa closed 3 months ago

paopa commented 3 months ago

This PR aims to add error handling to the evaluation process to prevent errors from affecting the results and also add a condition to avoid the error for Accuracy Metric. Additionally, it introduces a "failed count" metadata field into the summary trace, which will help us easily track the number of successful and failed traces.