tryolabs / luminoth

Deep Learning toolkit for Computer Vision.

https://tryolabs.com

BSD 3-Clause "New" or "Revised" License

2.4k stars 400 forks source link

[Evaluation] - Support multiple splits #244

Open JuanSeBestia opened 5 years ago

JuanSeBestia commented 5 years ago

Feature Request

I want to obtain the evaluation of different datasets of a single job lumi eval -h && lumi eval -c config_ssd.yml --split valid --split train --split test --watch --from-global-step 0

I understand that it is not so trivial because it was being kept as a summary of work scalars like this

sounds very crazy?

dekked commented 5 years ago

It's doable, and not crazy, to support multiple splits!

This looks to be a good first issue for contributing :man_dancing: