EleutherAI / pythia

The hub for EleutherAI's work on interpretability and learning dynamics
Apache License 2.0
2.16k stars 156 forks source link

Add training loss data #147

Open pietrolesci opened 6 months ago

pietrolesci commented 6 months ago

Task description: "Collect all loss values into CSV files from WandB and -- if needed -- log files".

The most important file is pythia_runs.tsv in which I manually collect the run references to use in the analysis. Since I do not have visibility on how the model was trained, I am best guessing which runs are the good ones, from the many present on Wandb, for each model size and seed.

CC @oskarvanderwal @haileyschoelkopf

CLAassistant commented 6 months ago

CLA assistant check
All committers have signed the CLA.