defog-ai / sql-eval

Evaluate the accuracy of LLM generated outputs
Apache License 2.0
448 stars 47 forks source link

Clarify integer qns #197

Closed wendy-aw closed 6 days ago

wendy-aw commented 6 days ago

Clarify some questions where sometimes the model would return an alternate query with a floating point number. The answer differs because using CURRENT_DATE and 'NOW' in the SQL can produce slightly different results.