tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

Apache License 2.0

478 stars 78 forks source link

#11795: Temporarily disable async dispatch #15318

Closed jbaumanTT closed 1 day ago

jbaumanTT commented 1 day ago

Ticket

15018

Problem description

The async ring buffer change seems to have caused some hangs in the LLAMA 3 70b tests, for unknown reasons.

What's changed

Reduce the number of launch messages that can be outstanding at once to 1, to avoid concurrency.

Checklist

[ ] Post commit CI passes
[ ] Blackhole Post commit (if applicable)
[ ] Model regression CI testing passes (if applicable)
[ ] Device performance regression CI testing passes (if applicable)
[ ] New/Existing tests provide coverage for changes