ShayanTalaei / CHESS

Contextual Harnessing for Efficient SQL Synthesis
Apache License 2.0
84 stars 21 forks source link

Release BIRD Dev predicted sqls #1

Closed CrZnGe closed 4 days ago

CrZnGe commented 2 months ago

I am interested in your promising work. Could you release the predicted sqls (file) of BIRD-dev?

nutor commented 1 month ago

Hi authors, I am also interested in your work and your results. Is it also possible for us to access your intermediate results (i.e., extracted keywords, etc.)? Thanks a lot.

JaviS-Rei commented 1 month ago

Release full results including json file will be very useful, since this work is incredebly money-consuming. I am glad to see your full results in GPT-3.5-Turbo and 4.

vibl commented 1 month ago

I would really be interested in the data too. I'm planning to publish an analysis of text-to-SQL methods that have published their code, in particular comparing their failure modes. Reproducing them would be time-consuming and expensive.

ShayanTalaei commented 4 days ago

Thank you all for your interest in our work and for your valuable feedback!

We’re happy to share that the results, including the predicted SQLs, intermediate outputs (e.g., extracted keywords), and full logs for the BIRD-dev set and other experiments, are now available in the results/ directory on the repository.

Please feel free to reach out if you have any further questions or feedback.

CrZnGe commented 3 days ago

Thanks! Best