JayZhang42 / FederatedGPT-Shepherd

Shepherd: A foundational framework enabling federated instruction tuning for large language models
https://arxiv.org/pdf/2305.05644.pdf
Apache License 2.0
202 stars 31 forks source link

Please, can you release the GPT-4 auto-evaluation? #6

Open PaulaDelgado-Santos opened 10 months ago

PaulaDelgado-Santos commented 10 months ago

Hello, I would like to have the GPT-4 assessment to evaluate your model and see your results. Did you use the evaluation 1) with easy questions [LINK] or 2) the one which address the GPT-4 limitations [LINK]? Please can you provide the whole assessment process you follow so I can replicate it? Thank you very much :)