search

BeachWang / DAIL-SQL

A efficient and effective few-shot NL2SQL method on GPT-4.
Apache License 2.0
427 stars 69 forks source link

About preliminary model graphix #36

Closed Zqzqsb closed 5 months ago

Zqzqsb commented 5 months ago

I have read your paper and replicated your experiment, but there's something I don't quite understand. Perhaps I missed it, but could you please point out to me how the preliminary model graphix is introduced in your code? I would greatly appreciate it!

BeachWang commented 5 months ago

Thank you for your interest in our work. It is just because I happen to know one of the authors of Graphix personally, and I can obtain the necessary results directly from them to facilitate our experiments.

kanseaveg commented 5 months ago

However, it seems they haven't provided the code for running Graphix-T5 on Bird. I would like to inquire how DAIL-SQL utilizes Graphix-T5 as a pre-generation model for reproduction?

BeachWang commented 5 months ago

I asked my friend to run a result on BIRD as well : )

Besides, I want to clarify that Graphix-T5 can be replaced with any other moderately performing model, Even the LLM itself.

kanseaveg commented 5 months ago

image This WeChat number, with the profile picture of your friend, is regrettably no longer being updated as he mentioned.😭

BeachWang commented 5 months ago

image This WeChat number, with the profile picture of your friend, is regrettably no longer being updated as he mentioned.😭

I'm sorry, I remembered incorrectly. We only run experiments with Graphix-T5 on Spider and Spider realistic, but not on Bird. We only run experiments with GPT-4 as the preliminary model on Bird.

kanseaveg commented 5 months ago

never mind.

BeachWang commented 5 months ago

I have uploaded the experiment results on BIRD dev with GPT-4 as the preliminary model to results.