Closed nix-apollo closed 8 months ago
Probable change is to go back to storing training information, etc in rib results. But I'm unsure what's best for consistency with modular mlp and eventually combining ablation scripts
Yeah I think I'd like to have all train information stored in the results. I'm going to work on this now and make a PR to main, since I'd like to have this in the refactor.
OK I decided against this to keep things consistent with lms. Otherwise it's a bit messier.
This change is breaking for run_mlp_ablations, as run_mlp_ablations expects to find mlp config information at
results["model_config"]["model"]
. Instead mlp rib build now stores only the mlp config info, omitting mlp training config, etc.