search

microsoft / rat-sql

A relation-aware semantic parsing model from English to SQL
https://arxiv.org/abs/1911.04942
MIT License
406 stars 117 forks source link

Execution accuracy #58

Open jayetri opened 3 years ago

jayetri commented 3 years ago

The function: eval_exec_match in ratsql/datasets/spider_lib/evaluation.py currently does not support multiple col_unit(pairs). Has someone corrected that code, so that it can calculate execution accuracies for datasets having multiple col_unit(pairs) as well as nested queries?