togethercomputer / MoA

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
Apache License 2.0
1.66k stars 208 forks source link

why the implement of `moa.py` isn't consistent with `inject_references_to_messages` #26

Open better629 opened 4 days ago

better629 commented 4 days ago

In the moa.py, the proposers' responses are jointed in user prompt, but the jointed content inside inject_references_to_messages is in system prompt. Why there is a inconsistency?