pytorch / benchmark

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
BSD 3-Clause "New" or "Revised" License
868 stars 283 forks source link

Optim Perf Signal Detected by TorchBench CI on 'a618118ba9ffc33097699c120e8760c0eb0f67fc' #1879

Closed github-actions[bot] closed 1 year ago

github-actions[bot] commented 1 year ago

TorchBench CI has detected a performance signal or runtime regression.

Base PyTorch commit: 9ea5b31c6fd45cd3139540d3da74a2a248f644d9

Affected PyTorch commit: a618118ba9ffc33097699c120e8760c0eb0f67fc

Affected Tests:

Tests that were no longer run on affected commit:

Tests that were newly added on affected commit:

Runtime regressions found? An errors log was found. Please investigate runtime errors by looking into the logs of the workflow linked.

GitHub workflow that triggered this issue: https://github.com/pytorch/benchmark/actions/runs/6105252415

cc @janeyx99

janeyx99 commented 1 year ago

@xuzhao9 doctr_det_predictor seems broken again :C

xuzhao9 commented 1 year ago

@janeyx99 Yeah, I pushed another fix yesterday and hopefully it will fix today.

xuzhao9 commented 1 year ago

@janeyx99 I can confirm that the doctr_det_predictor problem has been fixed.

janeyx99 commented 1 year ago

Talking offline about the random huge spikes with @xuzhao9 closing this to declutter and to centralize that discussion elsewhere