neulab / ExplainaBoard

Interpretable Evaluation for AI Systems
MIT License
360 stars 36 forks source link

Add text-to-SQL loader #591

Closed shuaichenchang closed 1 year ago

shuaichenchang commented 1 year ago

Overall

The second step of adding the text-to-SQL task in https://github.com/neulab/ExplainaBoard/pull/580

Details

Standard input files in the text-to-SQL task use a JSON file containing the database id, question, and gold query in each example. Standard output files are text files, where each line has a predicted query.