search

EleutherAI / pythia

The hub for EleutherAI's work on interpretability and learning dynamics
Apache License 2.0
2.16k stars 156 forks source link

Any results on the validation set? #121

Open chujiezheng opened 9 months ago

chujiezheng commented 9 months ago

Thanks for your valuable work! I wonder if there are any results on the validation set (if used)? Such as the validation ppl values.

StellaAthena commented 9 months ago

This has been on our to-do list. We have some train/val/test loss numbers but I don't think we have them systematically for every model & checkpoint.