search

mle-infrastructure / mle-toolbox

Lightweight Tool to Manage Distributed ML Experiments 🛠
https://mle-infrastructure.github.io/mle_toolbox/toolbox/
MIT License
3 stars 1 forks source link

Change seed indexing key in meta_log #11

Closed RobertTLange closed 3 years ago

RobertTLange commented 3 years ago

Currently the meta log .hdf5 generated in the grid/random seed sweeps have keys, which look like this: b_<batch_is>_eval_<iter_id>_seed-<seed_id>. The "-" makes it impossible to index via dotmap/dotdict and requires explicit dictionary key string indexing.

Cleaning this up will require rewriting the mean aggregation of the logs (which should be done anyways!) and the load_log function.

RobertTLange commented 3 years ago

Addressed in 60a7beea3d43c9ec3f8e113c3c1ef6b3f198e083 and 5dc561219c65b1a230ec632004e6b198d1e9547e