Open tt-rkim opened 1 month ago
a short term patch could be to call the reset.json?
/opt/tt_metal_infra/scripts
tt-smi should support the same reset.json input for single-chip cards so I think we can add a reset.json for single chip cards to make this reset mechanism uniform across every CI runners
Ideally we should try and bring up tt-smi-metal -r all as we previously had though...
I was thinking we could dynamically generate reset.json even for single chip machines and just call tt-smi-metal -r reset.json
everywhere
Currently, the pytest timeout infrastructure when using
xdist
in the non-post-commit pipeline usestt-smi-metal -r {device_ids}
to do their reset.For galaxy, this is insufficient. We need to supply
tt-smi
with the full reset JSON spec of the host + galaxy in order to properly the entire thing.We currently are doing this properly in the reset and cleanup scripts in CI, but not in
conftest.py
where we have thett-smi
reset infrastructure. We need a way of knowing how the current system is a galaxy-type system first, and then getting the reset json from somewhere.cc: @vtangTT @TT-billteng @ttmchiou @cglagovichTT @aliuTT