Where does ChatGPT stand in the leaderboard?

salesforce / WikiSQL

A large annotated semantic parsing corpus for developing natural language interfaces.

BSD 3-Clause "New" or "Revised" License

1.66k stars 326 forks source link

Where does ChatGPT stand in the leaderboard? #96

Open vvaezian opened 1 year ago

vvaezian commented 1 year ago

I asked a few text-to-SQL questions from chatGPT and its answers are pretty good. I'm wondering where does it stand in the leaderboard mentioned in the readme file.

fi5ee commented 9 months ago

Big language models are running harder datasets like spider

ChinaStark commented 1 week ago

For example, Codex （openai-gpt3） achieved the execution accuracy up to 67% on the Spider development set.