brianpetro / obsidian-smart-connections

Chat with your notes & see links to related content with AI embeddings. Use local models or 100+ via APIs like Claude, Gemini, ChatGPT & Llama 3
https://smartconnections.app
GNU General Public License v3.0
2.18k stars 154 forks source link

Smart Connections + Kobold or TextGen #598

Open Webslug opened 1 month ago

Webslug commented 1 month ago

Hi there, I am using a program called Kobold.cpp to run a model locally. I decided to try Smart Connections today and I tried to connect the plugin to kobold.

Model Name: Flam Protocol: http hostname: localhost Path: http://127.0.0.1:5001/v1/

I have tried various Paths but not seem to work. 127.0.0.1/api/latest/generate http://127.0.0.1:5001/v1/ /api/v1

However when ever I try to connect it says No Smart connections found.

Does Obsidian Smart Connections work with programs like Text-Gen-UI or Kobold.CPP on locally run models?

I can't seem to get it to work and I'd rather not use OpenAI or online third party services.

kobold

christianngarcia commented 1 month ago

Similar https://github.com/brianpetro/obsidian-smart-connections/issues/556