mlcommons / logging

MLPerf™ logging library
https://mlcommons.org/en/groups/best-practices-benchmark-infra
Apache License 2.0
29 stars 46 forks source link

[v4.0 improvement] rcp-bypass should be a per benchmark option instead of being applied to the whole submission #350

Closed nv-rborkar closed 6 months ago

nv-rborkar commented 7 months ago

2nd is already supported but it gets skipped for benchmarks if the submission has rcp-bypass. We should skip normalization only for the benchmark which requests rcp-bypass but nromalize other benchmarks as usual