search

briansunter / logseq-plugin-gpt3-openai

A plugin for GPT-3 AI assisted note taking in Logseq
https://twitter.com/bsunter
MIT License
700 stars 65 forks source link

Add support for oobabooga text generation webui API #132

Open NillPointer opened 5 months ago

NillPointer commented 5 months ago

The text-geneartion-webui by oobabooga allows you to run language models (like ChatGPT) locally on your machine (or on some external server). It already features a drop-in replacement for OpenAI API as specified here

The only changes required is to:

Have tested this locally, all seems fine. This shouldn't affect the existing OpenAI ChatGPT functionality, but will allow people to host/run local language models on servers/their machines.

briansunter commented 5 months ago

Looks great. I'm out of town right now but I'll test it next week.