Allow user to specify max prompt length

vanna-ai / vanna

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.

https://vanna.ai/docs/

MIT License

9.12k stars 673 forks source link

Closed ThomasBarnette closed 4 weeks ago

ThomasBarnette commented 4 weeks ago

Allowed the user to easily set the maximum prompt context length when configuring vanna

zainhoda commented 4 weeks ago

@ThomasBarnette great idea!