<question> Usage of local LLM instead of GPT API

DeepInsight-AI / DeepBI

LLM based data scientist, AI native data application. AI-driven infinite thinking redefines BI.

https://www.deepbi.com/

MIT License

1.54k stars 259 forks source link

<question> Usage of local LLM instead of GPT API #139

Open wtfc2 opened 1 month ago

wtfc2 commented 1 month ago

Since security is a priority and data sharing in some cases in not an option. I was thinking about using local hosted open source LLMs. Is that achievable and which LLMs do you recommend?

wangshiyouyang commented 2 weeks ago

We tried to access local LLMs, but so far the test results are not particularly suitable