search

microsoft / superbenchmark

A validation and profiling tool for AI infrastructure
https://aka.ms/superbench
MIT License
248 stars 55 forks source link

Release - SuperBench v0.10.0 #607

Closed abuccts closed 8 months ago

abuccts commented 8 months ago

Description

Cherry-pick bug fixes from v0.10.0 to main.

Major Revisions

Co-authored-by: Ziyue Yang ziyyang@microsoft.com Co-authored-by: Yang Wang yangwang1@microsoft.com Co-authored-by: Yuting Jiang yutingjiang@microsoft.com Co-authored-by: guoshzhao guzhao@microsoft.com

codecov[bot] commented 8 months ago

Codecov Report

Attention: 49 lines in your changes are missing coverage. Please review.

Comparison is base (2c2096e) 86.11% compared to head (0a3d8a4) 85.79%.

Files Patch % Lines
superbench/common/utils/device_manager.py 2.08% 47 Missing :warning:
...bench/benchmarks/model_benchmarks/megatron_gpt3.py 95.00% 1 Missing :warning:
...perbench/benchmarks/model_benchmarks/model_base.py 0.00% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #607 +/- ## ========================================== - Coverage 86.11% 85.79% -0.33% ========================================== Files 97 97 Lines 6873 6912 +39 ========================================== + Hits 5919 5930 +11 - Misses 954 982 +28 ``` | [Flag](https://app.codecov.io/gh/microsoft/superbenchmark/pull/607/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | Coverage Δ | | |---|---|---| | [cpu-python3.6-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/607/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `71.62% <42.39%> (-0.20%)` | :arrow_down: | | [cpu-python3.7-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/607/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `71.62% <42.39%> (-0.20%)` | :arrow_down: | | [cpu-python3.8-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/607/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `72.03% <42.39%> (-0.20%)` | :arrow_down: | | [cuda-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/607/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `83.87% <45.65%> (-0.28%)` | :arrow_down: | | [directx-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/607/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `34.56% <9.78%> (-0.73%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.