search

Cinnamon / kotaemon

An open-source RAG-based tool for chatting with your documents.
https://cinnamon.github.io/kotaemon/
Apache License 2.0
17.28k stars 1.33k forks source link

How to use Local LLM #486

Open scalenow opened 2 days ago

scalenow commented 2 days ago

Description

Sorry for the silly question .

Does Kotaemon has in built local LLM .I am not connected to any model yet document analysis is working .

How do I connect to my local LLM .i see option only for online model

Reproduction steps

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error
na

Screenshots

![DESCRIPTION](LINK.png)
na

Logs

na

Browsers

Chrome

OS

Linux

Additional information

na

taprosoft commented 1 day ago

Hi @scalenow please check this guide for local model integration with Ollama or HF https://github.com/Cinnamon/kotaemon/blob/main/docs/local_model.md