tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
https://docs.tenstorrent.com/ttnn/latest/index.html
Apache License 2.0
485 stars 79 forks source link

Bring WH device perf CI to post commit #13950

Open mo-tenstorrent opened 1 month ago

mo-tenstorrent commented 1 month ago

Currently device perf is a nightly.

WH B0 device perf can migrate out, run on VM and be part of post commit.

mo-tenstorrent commented 1 week ago

Running WH Device Perf CI on VM machines through custom dispatch

https://github.com/tenstorrent/tt-metal/actions/runs/11840131084

mo-tenstorrent commented 1 week ago

Looks like the test is failing with the same footprint as the device perf CI. i.e. It is fine to run it on VMs

mo-tenstorrent commented 1 week ago

@TT-billteng @tt-rkim @ttmchiou

TT-billteng commented 1 week ago

omg amazing!

TT-billteng commented 1 week ago

How many runs did you try?

mo-tenstorrent commented 1 week ago

I tried couple times a while back and then one test was failing for another stupid reason and the rest were ok.

I'll get folks to fix main today and I will run in a loop.