search

microsoft / superbenchmark

A validation and profiling tool for AI infrastructure
https://aka.ms/superbench
MIT License
248 stars 55 forks source link

Benchmarks: Microbenchmark - Support in-place for NCCL/RCCL benchmark #591

Closed yzygitzh closed 8 months ago

yzygitzh commented 9 months ago

Description Add in-place metrics for NCCL/RCCL benchmark for latency measurement.

codecov[bot] commented 8 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (606ff19) 86.11% compared to head (96adc71) 86.12%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## release/0.10 #591 +/- ## ================================================ + Coverage 86.11% 86.12% +0.01% ================================================ Files 97 97 Lines 6873 6878 +5 ================================================ + Hits 5919 5924 +5 Misses 954 954 ``` | [Flag](https://app.codecov.io/gh/microsoft/superbenchmark/pull/591/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | Coverage Δ | | |---|---|---| | [cpu-python3.6-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/591/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `71.83% <100.00%> (+0.02%)` | :arrow_up: | | [cpu-python3.7-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/591/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `71.83% <100.00%> (+0.02%)` | :arrow_up: | | [cpu-python3.8-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/591/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `72.24% <100.00%> (+0.02%)` | :arrow_up: | | [cuda-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/591/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `84.15% <100.00%> (+0.01%)` | :arrow_up: | | [directx-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/591/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `35.27% <8.33%> (-0.02%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.