search

ryanzhumich / editsql

MIT License
202 stars 68 forks source link

Confused about the Result #1

Closed SivilTaram closed 5 years ago

SivilTaram commented 5 years ago

Thank you for open sourcing your baselines and the awesome dataset :) I have a question about the performance of CD-seq2seq. In the paper and the leaderboard, the result is as follow:

image

But in the README.md file, I find it higher(almost improve 5% on question match result in dev) than the reported result. image

So I want to know which one is correct? Or, does the latest result in the README follow the setting in the paper? Thanks for your reply.

SivilTaram commented 5 years ago

Hi Bro?

taoyds commented 5 years ago

Hi,

The model in this repo is a slightly improved version. We will update the numbers in the paper.

SivilTaram commented 5 years ago

@taoyds I see, thanks for your reply :)