togethercomputer / MoA

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
Apache License 2.0
2.55k stars 352 forks source link

Does the agent support GPT, Gemini, Claude, etc. #16

Closed zsqdx closed 2 months ago

zsqdx commented 3 months ago

Hello contributors! I just want to know whether the agent supports GPT, Gemini, Claude, etc. as proposers. Thanks.

erik-sv commented 3 months ago

I iterated on sammcj's fork. It should work with any OpenAI formatted endpoint, including local models. I have tested LM Studio and Groq. Just create your own .env file based on the .env.template file where the first API is what you want your proposers to be, and API_2 is what you want your aggregator to be. https://github.com/erik-sv/MoA