search

tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
Apache License 2.0
396 stars 49 forks source link

Bump Tracy event ID to 32-bit from the current 16-bit #8105

Open mo-tenstorrent opened 4 months ago

mo-tenstorrent commented 4 months ago

Currently Tracy uses 16bit unsigned for its event IDs. That can run out in large models. Switch to 32-bit for these IDs

This will be a breaking change on GUI, thus requiring version bump for proper error handling.

Also make DRAM size optional through a build variable. With the increased speed from switching to EnqueueBuffer DRAM fetch we can afford to fetch larger buffers if there is room

mo-tenstorrent commented 2 months ago

Currently full 10 iteration bert with dumps every iteration is not fitting into 16-bit event ID