search

vanna-ai / vanna

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
https://vanna.ai/docs/
MIT License
11.04k stars 862 forks source link

Supporting AutoModelForCausalLM #385

Closed jis478 closed 5 months ago

jis478 commented 5 months ago

Hi, I'm writing a new class like this for models in the AutoModelForCausalLM format. Originally I've been testing sql-coder model with this but thought this could be generalized as a class. Do you have an on-going PR or can i make one?

zainhoda commented 5 months ago

This isn't something that I've heard from other users so please feel free to make a PR!

jis478 commented 5 months ago

Thanks, I've made PR (https://github.com/vanna-ai/vanna/pull/391)

jis478 commented 5 months ago

By the way the original Sql-coder repo is also implemented using the Huggingface Transformers library with its own prompt template. As pointed out in https://github.com/vanna-ai/vanna/issues/303#issuecomment-2052692155, it would be great if you tested it out again with the original repo (I'm currently working on getting it to run on Vanna, based on this PR as well)

andreped commented 5 months ago

By the way the original Sql-coder repo is also implemented using the Hugging Face Transformers library with its own prompt template. As pointed out in #303 (comment), it would be great if you tested it out again (I'm currently working on getting it to run on Vanna, based on this PR as well)

Would be of interest to me as well, @zainhoda. Great suggestion, @jis478! :]