search

MohammadrezaPourreza / Few-shot-NL2SQL-with-prompting

MIT License
318 stars 65 forks source link

Confusion about the experimental results #8

Open linxin6 opened 1 year ago

linxin6 commented 1 year ago

Please confirm if the exec acc of DIN-SQL on the validation set is 74.1?

MohammadrezaPourreza commented 1 year ago

The test suite accuracy we got on the dev set of spider using this https://github.com/taoyds/test-suite-sql-eval script is 74.1.

linxin6 commented 1 year ago

Thank you for your reply.

A11en0 commented 1 year ago

Can't reproduce the results 74.1, could you please give a more detailed command you used with the script?