search

defog-ai / sqlcoder

SoTA LLM for converting natural language questions to SQL queries
Apache License 2.0
3.27k stars 205 forks source link

How can I fine tune sqlcoder-7b 2 model over my onw query? #74

Closed kasldsaknf closed 6 months ago

rishsriv commented 6 months ago

Hi there, you can use any of the fine-tuning approaches made available by open-source libraries. For instance, using TRL or axolotl

Please remember to open-source any fine-tunes you make, to comply with the model's cc-by-sa-4.0 license

kasldsaknf commented 6 months ago

Thank you very much for the open source work and models. I dont know it well. Should I use the Llama finetuning script and instructions for defog/sqlcoder-7b-2? I see "llama" tag on the huggingface :)

rishsriv commented 6 months ago

Yup - the Llama finetuning script should work well!

mellahysf commented 6 months ago

@kasldsaknf did you have a chance to establish a new finetuning on top of sqlcoder model using your own dataset? if yes please share your script/code.

Thank you.

kasldsaknf commented 6 months ago

@mellahysf I haven't fine tune sqlcoder over my own dataset. I think Llama's fine tune code should work. Did you meet some probelms now?

kasldsaknf commented 6 months ago

Yup - the Llama finetuning script should work well!

Thank you. I will try.