Mindinventory / MindSQL

MindSQL: A Python Text-to-SQL RAG Library simplifying database interactions. Seamlessly integrates with PostgreSQL, MySQL, SQLite, Snowflake, and BigQuery. Powered by GPT-4 and Llama 2, it enables natural language queries. Supports ChromaDB and Faiss for context-aware responses.
https://www.mindinventory.com/text-to-sql-mindsql.php?utm_source=sampromotiion&utm_medium=Button&utm_campaign=sampromotion&utm_id=sampromotion&utm_term=sampromotiion&utm_content=sampromotiion
GNU General Public License v3.0
224 stars 18 forks source link

Adding custom configurations for Llama #5

Closed guitmonk-1290 closed 8 months ago

guitmonk-1290 commented 8 months ago

The context window in Llama is set to 512 by default. This can cause the prompt size to exceed the context window size if the DB schema is large enough.

It would be great if custom configuration for the Llama function from LlamaCpp can be passed in the config object for better control.