togethercomputer / MoA

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
Apache License 2.0
2.6k stars 356 forks source link

Missing AlpacaEval gpt4 reference results - results/gpt4_1106_preview/model_outputs.json #21

Open morganmcg1 opened 5 months ago

morganmcg1 commented 5 months ago

Thanks for the great repo + paper team!

I think results/gpt4_1106_preview/model_outputs.json is missing from the alpaca_eval directory, I'm getting a warning atm:

https://github.com/tatsu-lab/alpaca_eval/blob/main/results/gpt4_1106_preview/model_outputs.json

The eval runs fine once I add the file to alpaca_eval/results/gpt4_1106_preview/model_outputs.json