togethercomputer / MoA

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
Apache License 2.0
1.67k stars 208 forks source link

feat: support configurable API endpoints #12

Closed sammcj closed 2 weeks ago

sammcj commented 2 weeks ago

Draft / needs testing and probably other files updated

*Edit, Got it up and working with local LLMs, but there ended up being a lot of changes which I think are probably beyond the demo of this repo, welcome to check it out (https://github.com/sammcj/MoA/tree/main) but closing this PR.