search

pytorch / test-infra

This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic to track disabled tests and slow tests, as well as our continuation integration jobs HUD/dashboard.
https://hud.pytorch.org/
Other
84 stars 87 forks source link

Display MPS benchmark results in eager mode #6006

Closed huydhn closed 1 month ago

huydhn commented 1 month ago

This goes together with https://github.com/pytorch/pytorch/pull/142034. MPS benchmark is running in eager mode at the moment.

vercel[bot] commented 1 month ago

@huydhn is attempting to deploy a commit to the Meta Open Source Team on Vercel.

A member of the Team first needs to authorize it.

vercel[bot] commented 1 month ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Updated (UTC)
torchci ✅ Ready (Inspect) Visit Preview Dec 4, 2024 7:21am
huydhn commented 1 month ago

Here it is https://torchci-git-fork-huydhn-mps-benchmark-fbopensource.vercel.app/benchmark/compilers?dashboard=torchinductor&startTime=Wed%2C%2027%20Nov%202024%2017%3A44%3A45%20GMT&stopTime=Wed%2C%2004%20Dec%202024%2017%3A44%3A45%20GMT&granularity=hour&suite=torchbench&mode=inference&dtype=notset&deviceName=mps&lBranch=mps-benchmark-filename&lCommit=4a85860fd7c502089b864302b894f22e3122c606&rBranch=mps-benchmark-filename&rCommit=4a85860fd7c502089b864302b894f22e3122c606, it shows mps device

huydhn commented 1 month ago

Is the MPS view expected to only have a single datapoint for that week long time window?

Oh, the data only shows up on the dashboard correctly after I land https://github.com/pytorch/pytorch/pull/142034 yesterday, and the job is scheduled daily. So, there is only one data point atm.