search

saif-ellafi / play-by-the-writing

Play by the Writing is a bundle of scripts for Espanso, written in python to expand SOLO RPG rulesets as you write
Apache License 2.0
23 stars 6 forks source link

Support configuring base_url #14

Open hardliner66 opened 2 months ago

hardliner66 commented 2 months ago

It would be nice if we could configure the base url, then people could use offline models via ollama or similar tools.

ParaplegicRacehorse commented 3 weeks ago

I agree. I run my own AI inference servers (Several LLMs, Two stable diffusions, a TTS with SR, a voice-clone, a music-gen) specifically to avoid sending data into the clutches of Sam Altman and other egomaniacs.

I would like to be able to use my own inference servers.

Even the AI Horde would be preferable to OAI.