Add support for open source LLM models like LLama2/Mistral

stratosphereips / shelLM

Code for shelLM tool

Other

41 stars 6 forks source link

Add support for open source LLM models like LLama2/Mistral #2

Open Sajid576 opened 6 months ago

Sajid576 commented 6 months ago

Hi, I want to a add support for open source LLM models like Llama2 using langchain that will be self hosted in local and it will not be required to have gpu support to run. but GPU support will make it reply faster. In this way I want to reduce COST for chatgpt api.how is the idea?

t3chn0m4g3 commented 3 weeks ago

Ollama support would be great, is this planned?