togethercomputer / MoA

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
Apache License 2.0
2.6k stars 356 forks source link

why the implement of `moa.py` isn't consistent with `inject_references_to_messages` #26

Open better629 opened 4 months ago

better629 commented 4 months ago

In the moa.py, the proposers' responses are jointed in user prompt, but the jointed content inside inject_references_to_messages is in system prompt. Why there is a inconsistency?