ND output tokens for Falcon7b galaxy demo

tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

Apache License 2.0

393 stars 48 forks source link

ND output tokens for Falcon7b galaxy demo #11254

Open skhorasganiTT opened 1 month ago

skhorasganiTT commented 1 month ago

The output of the Falcon7b galaxy demo with greedy decoding differs between runs.

Branch: main Command: pytest --disable-warnings -q -s --input-method=json --input-path='models/demos/tg/falcon7b/input_data_tg.json' models/demos/tg/falcon7b/demo_tg.py::test_demo_multichip[wormhole_b0-True-user_input0-32chipTG-True-default_mode_1024_greedy_verify] Machine: aus-glx-09

skhorasganiTT commented 1 month ago

Potentially related to #10946