Open GobDevv opened 3 months ago
I second this. I personally use LM Studio which has an openAI compatible server mode.
I am using Open Web UI to connect to multiple instances of Ollama that are installed on a variety of local PCs (none of which are all that powerful) I'd like to be able to connect Page Assist to OpenWebUI so that it could route the requests to the pool of Ollamas and spread the load.
This would allow people to use other self hosted options like jan.ai or Textgen webui in addition to ollama which would help open this app to more ecosystems.