how to deploy this locally with ollama UIs like `Open WebUI` and `Lobe Chat` ?

togethercomputer / MoA

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models

Apache License 2.0

2.55k stars 352 forks source link

how to deploy this locally with ollama UIs like `Open WebUI` and `Lobe Chat` ? #14

Open hemangjoshi37a opened 3 months ago

itsmebcc commented 3 months ago

I do not think there is currently an API for this.

IsThatYou commented 3 months ago

Hi, so we don't currently have support for deploying locally. Although our APIs should be compatible with any OpenAI compatible api. So one could setup vLLMs for example locally with some modification of the code.