pytorch / benchmark

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
BSD 3-Clause "New" or "Revised" License
817 stars 259 forks source link

Improve the ci by separating CPU and CUDA tests #2327

Closed xuzhao9 closed 1 week ago

xuzhao9 commented 1 week ago

Currently we are running both CPU and CUDA tests in the A100/A10G runners. This is a waste of resource. In this PR, we separate CPU and CUDA tests with different runners. The CUDA tests still run on the GCP A100 runner, while the CPU tests runs on a CPU-only runner of linux.24xlarge.

Reduces the CI time from ~120m to ~90m.

Fixes https://github.com/pytorch/benchmark/issues/2135

facebook-github-bot commented 1 week ago

@xuzhao9 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot commented 1 week ago

@xuzhao9 merged this pull request in pytorch/benchmark@1f982392be22770de29e083b29c84f43dbbd4cbe.