defog-ai / sql-eval

Evaluate the accuracy of LLM generated outputs
Apache License 2.0
485 stars 52 forks source link

Query and parsing fixes #130

Closed wongjingping closed 2 months ago

wongjingping commented 2 months ago

fix erroneous sql (no columns required within GROUP BY {}) add stop characters to facilitate parsing from other prompt formats update tests with an extra case testing GROUP BY {} expansion