vanna-ai / vanna

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
https://vanna.ai/docs/
MIT License
11.04k stars 862 forks source link

Support for choosing number of follow-up questions to be generated #315

Closed andreped closed 6 months ago

andreped commented 6 months ago

Is your feature request related to a problem? Please describe. Right now, it does not seem like Vanna chooses how many follow-up questions to be generated by the LLM. As per the code: https://github.com/vanna-ai/vanna/blob/c8201f5d2c3fc1aecb95d47e4c7c6703baf39a7c/src/vanna/base/base.py#L170

It would also make sense to have a default number of follow-up questions to be generated, say 3.

Describe the solution you'd like An API to choose how many follow-up questions to suggest (could make completion faster if fewer suggestions are of interest).

I can make a PR to address this feature request.