menpo / menpobench

Standardized deformable model benchmarking
BSD 3-Clause "New" or "Revised" License
11 stars 5 forks source link

support custom modules in output dir #10

Open jabooth opened 9 years ago

jabooth commented 9 years ago

Currently we aren't too careful about the naming of everything in the output directory. If a user runs an experiment with lots of custom modules (e.g. custom dataset, custom lm_processing, custom methods, custom normalisation results) we currently will just hit strange errors in the output. I had a little go at ensuring these problems would be mitigated at least for the error_name here:

        name = '{}_{}'.format(i, Path(error_name).name.replace('.', '_'))

but clearly this requires deeper thought to work for all modules.