search

microsoft / superbenchmark

A validation and profiling tool for AI infrastructure
https://aka.ms/superbench
MIT License
248 stars 55 forks source link

Benchmarks: Micro benchmark - Add graph mode in NCCL/RCCL benchmarks for latency metrics #583

Closed yzygitzh closed 9 months ago

yzygitzh commented 9 months ago

Description Revise NCCL/RCCL benchmarks to add latency metrics.

codecov[bot] commented 9 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (9ae8c67) 86.36% compared to head (17af897) 86.36%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #583 +/- ## ======================================= Coverage 86.36% 86.36% ======================================= Files 96 96 Lines 6572 6573 +1 ======================================= + Hits 5676 5677 +1 Misses 896 896 ``` | [Flag](https://app.codecov.io/gh/microsoft/superbenchmark/pull/583/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | Coverage Δ | | |---|---|---| | [cpu-python3.6-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `71.78% <100.00%> (+<0.01%)` | :arrow_up: | | [cpu-python3.7-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `71.78% <100.00%> (+<0.01%)` | :arrow_up: | | [cpu-python3.8-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `72.22% <100.00%> (+<0.01%)` | :arrow_up: | | [cuda-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/583/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `84.30% <100.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.