Wrong files in eval? - Githubissues

EleutherAI / pythia

The hub for EleutherAI's work on interpretability and learning dynamics

Apache License 2.0

2.16k stars 156 forks source link

Wrong files in eval? #139

Open borgr opened 8 months ago

borgr commented 8 months ago

In the pythia-160m, 410m, 1.4b five-shot the configs say num_fewshot:0 I presume the wrong files were copied (the zero shot ones) pythia-v0/pythia-160m/five-shot