search

Dataherald / dataherald

Interact with your SQL database, Natural Language to SQL using LLMs
https://dataherald.readthedocs.io/en/latest/
Apache License 2.0
3.34k stars 235 forks source link

Custom LLM Model #259

Closed Namec999 closed 8 months ago

Namec999 commented 11 months ago

Hello All,

trying to use Dataherald with mistral LLM or with the new SQLCoder

does any one achieved this before, and post some step by step guide to use custom llm models.

best

MohammadrezaPourreza commented 10 months ago

@Namec999 Hi, I'm working on the open-source LLMs integration with Dataherald, I will write a step by step guide as soon as I can. The issue is that most of open-source LLMs are not good at function calling, so we resort to GPT family.

Namec999 commented 10 months ago

thank you, that will be greate

i am also trying nexusraven open source llm that outperforms the GPT family in function calling

alifzl commented 10 months ago

Dear @MohammadrezaPourreza , is there any chance that we utilize custom llama-based LLMs in dataherald? consider using PEFT models like nexusraven with larger parameter size.

deeteeakl commented 9 months ago

@Namec999 Hi, I'm working on the open-source LLMs integration with Dataherald, I will write a step by step guide as soon as I can. The issue is that most of open-source LLMs are not good at function calling, so we resort to GPT family.

What about ability to work with Azure OpenAI? Is that an option?

ankur198 commented 9 months ago

I have attempted to do it. Please have a look it https://youtu.be/ksafgK-S_ko?si=wdx-5Ov4dHYSE6N0

MohammadrezaPourreza commented 8 months ago

@alifzl @ankur198 @deeteeakl @Namec999 I'm sorry for the delay in getting back to you, but I have some exciting news to share! We now support open-source LLMs, and you can easily use any model from Hugging Face with our tool. We've merged the code, and I'll be writing a blog post to guide you through the process soon. Thank you!

alifzl commented 8 months ago

@alifzl @ankur198 @deeteeakl @Namec999 I'm sorry for the delay in getting back to you, but I have some exciting news to share! We now support open-source LLMs, and you can easily use any model from Hugging Face with our tool. We've merged the code, and I'll be writing a blog post to guide you through the process soon. Thank you!

@MohammadrezaPourreza looking forward to check the blog post of yours in order to check how we can use and fine tune Local Custom LLMs in your great solution.

cheers.

moltar commented 8 months ago

@MohammadrezaPourreza Have you documented or blogged the approach for custom LLM setup yet? Cheers?