Canner / WrenAI

🚀 Open-source SQL AI Agent for Text-to-SQL. Make Text2SQL Easy! 🙌
https://getwren.ai/oss
GNU Affero General Public License v3.0
1.73k stars 155 forks source link

feat(wren-ai-service): support sub-pipeline evaluation #582

Closed paopa closed 1 month ago

paopa commented 1 month ago

This PR introduces support for sub-pipeline evaluation, fixes the extract_units function to handle cases without a foreign key pattern, and enhances trace metadata for better identification of evaluation results.

How to Evaluate the Sub-Pipeline

To evaluate a specific sub-pipeline, specify the pipeline name in the predict command. The evaluation command remains unchanged.

just predict <evaluation-dataset> <pipeline-name>

Screenshots

image image