U-Net3D update for MLPerf 2.0

mlcommons / training

Reference implementations of MLPerf™ training benchmarks

https://mlcommons.org/en/groups/training

Apache License 2.0

1.6k stars 553 forks source link

Closed mmarcinkiewicz closed 2 years ago

mmarcinkiewicz commented 2 years ago

Proposed changes:

Restored multi-gpu (multi-device) training and evaluation
- DistributedSampler does not support last batch padded functionality, therefore last batch dropped is used.
- Readme was updated to accommodate the changes
- No changes in evaluation schedule are proposed - the dependency on revised samples per epoch still holds
Fixed performance issues with gradient accumulation

github-actions[bot] commented 2 years ago

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

mmarcinkiewicz commented 2 years ago

@johntran-nv is there anything else we need to get this merged?