search

microsoft / superbenchmark

A validation and profiling tool for AI infrastructure
https://aka.ms/superbench
MIT License
248 stars 55 forks source link

Benchmarks: Add benchmark: Megatron-LM/Megatron-Deepspeed GPT pretrain benchmark #582

Closed yukirora closed 9 months ago

yukirora commented 9 months ago

Description Megatron-LM/Megatron-Deepspeed GPT pretrain benchmark

codecov[bot] commented 9 months ago

Codecov Report

Attention: 65 lines in your changes are missing coverage. Please review.

Comparison is base (254ea7f) 86.36% compared to head (5a47989) 85.98%.

Files Patch % Lines
...bench/benchmarks/model_benchmarks/megatron_gpt3.py 76.89% 61 Missing :warning:
...perbench/benchmarks/model_benchmarks/model_base.py 55.55% 4 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #582 +/- ## ========================================== - Coverage 86.36% 85.98% -0.38% ========================================== Files 96 97 +1 Lines 6573 6845 +272 ========================================== + Hits 5677 5886 +209 - Misses 896 959 +63 ``` | [Flag](https://app.codecov.io/gh/microsoft/superbenchmark/pull/582/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | Coverage Δ | | |---|---|---| | [cpu-python3.6-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/582/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `71.99% <76.36%> (+0.20%)` | :arrow_up: | | [cpu-python3.7-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/582/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `71.99% <76.36%> (+0.20%)` | :arrow_up: | | [cpu-python3.8-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/582/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `72.40% <76.36%> (+0.18%)` | :arrow_up: | | [cuda-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/582/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `84.00% <76.36%> (-0.30%)` | :arrow_down: | | [directx-unit-test](https://app.codecov.io/gh/microsoft/superbenchmark/pull/582/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft) | `35.31% <31.63%> (-0.17%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=microsoft#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.