Did you use Spider-dev as the examples set when evaluate Spider-test

BeachWang / DAIL-SQL

A efficient and effective few-shot NL2SQL method on GPT-4.

Apache License 2.0

387 stars 65 forks source link

Did you use Spider-dev as the examples set when evaluate Spider-test #19

Closed wasedawesley closed 7 months ago

wasedawesley commented 8 months ago

hi，thanks for sharing DAIl-SQL codes. We notice the improvements by DAIL demo selection(EuclideanDistanceQuestionMaskPreSkeletonSimilarThresholdSelector)

Here is my question: When evaluating at Spider-Test, did you add Spider-dev into the demo sets?

BeachWang commented 8 months ago

Hi, We only use the Spider-Train as the demo sets when evaluating at Spider-Test.