search

Dataherald / dataherald

Interact with your SQL database, Natural Language to SQL using LLMs
https://dataherald.readthedocs.io/en/latest/
Apache License 2.0
3.35k stars 234 forks source link

Open Source Dataherald with custom model #424

Closed santurini closed 8 months ago

santurini commented 8 months ago

Hello, thank you for open sourcing this amazing project. I would like to explore the framework in local using the opensource version. I would like to fine-tune an HuggingFace model on the golden queries and then exploit the dataherald framework to connect with the data source and use the endpoints. Is this possible with the open source version using a docker app?

Thank you for your help!

aazo11 commented 8 months ago

Hi @santurini -- yes this is possible. We recently added this support and will publish some documentation on it in the next 3-4 days.

santurini commented 8 months ago

Looking forward to it! Will there also be instructions on how to fine-tune the models in order to be compliant?

Thank you for this great work!!

aazo11 commented 8 months ago

Hi @santurini here is the blog post on how to use open source LLMs. This does not include instructions on how to fine-tune but we will be adding that soon as well. https://medium.com/dataherald/how-to-use-mixtral-8x7b-for-text-to-sql-9ae8bb52a3c3

santurini commented 8 months ago

Thank you very much!