Closed georgelyuan closed 1 year ago
@georgelyuan do you still think this is important? If so, could you propose a PR to fix https://github.com/mlcommons/policies/blob/master/submission_rules.adoc#directory-structure and then we can all follow that?
Pablo's scripts work fine with the status quo. Unless others also feel strongly about this I'm okay with letting it go.
In inference, the top-level directory is separated by open/ and closed/ categories, while in training all results are together. Consider making the directory structure consistent across inference and training.