taoyds test-suite-sql-eval issues

taoyds / test-suite-sql-eval

Semantic Evaluation for Text-to-SQL with Distilled Test Suites

Apache License 2.0

232 stars 62 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

This test method seems not stable

#26 lianshan01 opened 1 month ago
1
Inconsistent SQL Query Results on Different Systems

#25 minger-hsxz opened 5 months ago
0
Update exec_eval.py

#24 seb711 opened 6 months ago
0
Request to Add Support for `UNION ALL` Keyword

#23 vxwong opened 6 months ago
0
Add asyncio module and use asyncio.run to execute exec_on_db asynchro…

#22 BahozHagi opened 9 months ago
0
Bug with evaluating SQLs containing "value" identifiers

#21 BugMaker-Boyan opened 10 months ago
1
Bug with tables aliases

#20 klima7 closed 1 year ago
1
Bug with tables aliases

#19 klima7 opened 1 year ago
2
Support Projection Aliases

#18 niryarden opened 1 year ago
2
Support Aliases without 'AS'

#17 niryarden opened 1 year ago
0
Difference between two evaluation codes

#16 hoangdzung opened 1 year ago
0
Stuck for sqls and no error message

#15 nlp-focus opened 1 year ago
2
Doesn't support inner join

#14 nuoma opened 1 year ago
0
require the in replace value not to be part of other tokens

#13 shuaichenchang opened 1 year ago
0
Checking permutations of all columns doesn't scale

#12 sebastko opened 2 years ago
0
Database for the 11 Text-to-SQL tasks

#11 awasthiabhijeet closed 2 years ago
2
Data mismatch in Geography

#10 PosoSAgapo opened 2 years ago
0
Classical Evaluation code cannot run

#9 PosoSAgapo opened 2 years ago
5
The metric does not give same report

#8 PosoSAgapo opened 2 years ago
0
Evaluation returns 1 when it should return 0

#7 Hazoom opened 3 years ago
1
use asyncio instead of subprocess to limit execution time

#6 rizar closed 3 years ago
0
submission email may be blocked, #server did not respond, re-delivering#

#5 ZLCaesar closed 3 years ago
2
Can I user the former method to evaluate my test results?

#4 Twsschx closed 3 years ago
5
error in database/readme.txt

#3 rizar closed 4 years ago
1
sqlparse dependency not documented

#2 rizar closed 4 years ago
1
different number of queries in Academic, IMDB, etc. (compared to the original distribution)

#1 rizar opened 4 years ago
11