Feature request: Please allow API from text-generation-webui

alondmnt / joplin-plugin-jarvis

Joplin (note-taking) assistant running a very intelligent system (OpenAI/GPT, Hugging Face, Gemini, Llama, Universal Sentence Encoder, etc.)

GNU Affero General Public License v3.0

209 stars 22 forks source link

Feature request: Please allow API from text-generation-webui #15

Closed SmoothBrainApe closed 4 months ago

SmoothBrainApe commented 7 months ago

Hi,

I want to try connecting Jarvis using oobabooga/text-generation-webui as a backend instead of openai for private and offline solution. Is that possible? Thanks!

alondmnt commented 7 months ago

I believe this should be possible with the current version of Jarvis. Follow the instructions here, but use the following URL for Chat: Custom model API endpoint: http://127.0.0.1:5000/v1/chat/completions (based on this example)