mlcommons / training

Reference implementations of MLPerf™ training benchmarks
https://mlcommons.org/en/groups/training
Apache License 2.0
1.58k stars 549 forks source link

Mirror inference directory structure #464

Closed georgelyuan closed 1 year ago

georgelyuan commented 3 years ago

In inference, the top-level directory is separated by open/ and closed/ categories, while in training all results are together. Consider making the directory structure consistent across inference and training.

johntran-nv commented 1 year ago

@georgelyuan do you still think this is important? If so, could you propose a PR to fix https://github.com/mlcommons/policies/blob/master/submission_rules.adoc#directory-structure and then we can all follow that?

georgelyuan commented 1 year ago

Pablo's scripts work fine with the status quo. Unless others also feel strongly about this I'm okay with letting it go.