ttnn BERT demo with poor PCC

tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

Apache License 2.0

441 stars 63 forks source link

ttnn BERT demo with poor PCC #6627

Open cfjchu opened 7 months ago

cfjchu commented 7 months ago

Repro command

pytest --disable-warnings --input-path="models/demos/bert/demo/input_data.json" "models/demos/bert/demo/demo.py::test_demo[models.demos.bert.tt.ttnn_optimized_bert-phiyodr/bert-large-finetuned-squad2]"

eyonland commented 6 months ago

@arakhmati , this might be related #6638 ?

xanderchin commented 6 months ago

Debugged to split_query_key_value_and_split_heads. Highly likely related to #6805 as we are also using block sharding.