issues
search
vanna-ai
/
vanna
🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
https://vanna.ai/docs/
MIT License
9.97k
stars
737
forks
source link
huggingface model support added
#391
Closed
jis478
closed
2 months ago
jis478
commented
2 months ago
Hugginface model support added. In detail, it supports models loaded with
AutoTokenizer' and 'AutoModelForCausalLM
from 'transformer' library.
apply_chat_template
is being used, which assumes that the models being used are chat-based models rather than completion models.
AutoTokenizer' and 'AutoModelForCausalLMfrom 'transformer' library.apply_chat_templateis being used, which assumes that the models being used are chat-based models rather than completion models.