search

alondmnt / joplin-plugin-jarvis

Joplin (note-taking) assistant running a very intelligent system (OpenAI/GPT, Hugging Face, Gemini, Llama, Universal Sentence Encoder, etc.)
GNU Affero General Public License v3.0
209 stars 22 forks source link

Local Open Source Options #22

Closed Willxiam closed 4 months ago

Willxiam commented 4 months ago

First thanks for the energy and effort that has been put into this plugin.

I found two additional local opensource options

I discovered https://github.com/janhq/jan when I was researching LM Studio. I came across it in a LM Studio post on reddit that expressed both praise of LMStudio and also concerns about its future as they go more and more commercial.

Someone from the jan.ai team also posted this https://twitter.com/janframework/status/1745472833579540722?t=osxIAvq8ztXuDbNAm11thA praising Ava

I just wanted to these on people's radar.

I am a little out of my element here, but I do hope to figure out a way to make this plugin work using the guide with my joplin.

Edited: corrected links

alondmnt commented 4 months ago

Thanks for the info! Will check it out.

I believe that it will work if you follow the LiteLLM/ollama settings in the guide (put the name of the model that you run in jan under Chat: OpenAI (or compatible) custom model ID), and set the endpoint to: http://localhost:1337/v1/chat/completions

Willxiam commented 4 months ago

Well that does not seem too hard. I hope to try it out but probably not until next week.

alondmnt commented 4 months ago

Added it to the guide.