Canner / WrenAI

🚀 Open-source SQL AI Agent for Text-to-SQL. Make Text2SQL Easy! 🙌
https://getwren.ai/oss
GNU Affero General Public License v3.0
1.73k stars 155 forks source link

feat(wren-ai-service): Implement evaluation metrics #544

Closed paopa closed 2 months ago

paopa commented 2 months ago

This PR aims to enhance support for evaluation metrics by implementing a column-based version, consolidating multiple actual outputs into a single trace, and updating the README to reflect the changes in the evaluation process. Additionally, it includes the removal of outdated evaluation code to streamline the system.

Screenshots

image image image image