search

tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
Apache License 2.0
303 stars 26 forks source link

`models/experimental/stable_diffusion/tests/` failures - GS only #7536

Open vtangTT opened 2 months ago

vtangTT commented 2 months ago

These SD tests are GS only run in the Nightly FD suite, currently failing with the same signature:

launch_with_autoformat must be used if output tensor for op can be placed on host.

RuntimeError: TT_ASSERT @ tt_eager/tt_dnn/op_library/run_operation.cpp:713: outputs.at(i).tensor_attributes->dynamic_storage

pytest models/experimental/stable_diffusion/tests/test_cross_attn_down_block.py -k test_run_cross_attn_down_block_real_input_inference

pytest models/experimental/stable_diffusion/tests/test_cross_attn_up_block.py -k test_run_cross_attn_up_block_real_input_inference

pytest models/experimental/stable_diffusion/tests/test_unet_mid_block.py -k test_run_unet_mid_block_real_input_inference

pytest models/experimental/stable_diffusion/tests -k test_unbatched_stable_diffusion

Skipping on CI until fixed

CC: @tt-rkim @TT-billteng

vtangTT commented 2 months ago

CC: @jliangTT

jliangTT commented 2 months ago

I think most of the development of stable_diffusion is on WH. @AleksKnezevic @boris-drazic , is this GS current p2?

AleksKnezevic commented 2 months ago

Yes, that's correct. We're only targeting wormhole at this time.

jliangTT commented 2 months ago

will demote to P2 until priority changes.