mle-infrastructure / mle-toolbox

Lightweight Tool to Manage Distributed ML Experiments 🛠
https://mle-infrastructure.github.io/mle_toolbox/toolbox/
MIT License
3 stars 1 forks source link

md, html & pdf report generation #23

Closed RobertTLange closed 3 years ago

RobertTLange commented 3 years ago

This PR addresses issue #6. We add a new primitive report-experiment which can be executed from the command line. It asks the user to select an experiment id and afterwards generates a set of reports (.md, .html, .pdf) in a report directory as well as 1D/2D figures in a figures directory. They are constructed from the meta_log.hdf5 and hyper_log.pkl files. Everything can be automatically achieved by keeping track of the search variables. Furthermore, we add a new option to the meta_job_args in the experiment .yaml file which automatically creates the reports the report at the end of the experiment. Finally, the report can incorporate figures from a post_processing job if the results figures are stored in the figures directory of the experiment. See report example below:

Bildschirmfoto 2021-02-16 um 10 30 02 (2)