Add support for local/other LLMs

[pramitchoudhary]

Experimentation in progress

• NSQL, https://huggingface.co/NumbersStation/nsql-6B dataset used: Initial benchmark shared:

• [x] Few-shot prompting, TBD more details

• [ ] Fine-tune, in--progress TBD more details

• [x] NumbersStation/nsql-llama-2-7B LLAMA2 version: https://www.numbersstation.ai/post/nsql-llama-2-7b

• [x] SQLCoder2, https://x.com/rishdotblog/status/1709574909234712963?s=12&t=ljP6NxOMY7vMgYSITKIO4A

• [x] sqlcoder-34b-alpha, https://huggingface.co/defog/sqlcoder-34b-alpha

• Flan-T5, briefly explored, looks promising

• RESDSQL-3B, pending

• LAMA2, https://arxiv.org/pdf/2307.09288.pdf

• [ ] Mixtral 8x7B https://x.com/GuillaumeLample/status/1734216551752929319?s=20

[pramitchoudhary]

Wavecoder: https://arxiv.org/pdf/2312.14187.pdf