tenstorrent / tt-mlir

Tenstorrent MLIR compiler
https://tenstorrent.github.io/tt-mlir/
Apache License 2.0
51 stars 7 forks source link

TTNN Op Interface: Op Perf model #305

Open rjakovljevicTT opened 1 month ago

rjakovljevicTT commented 1 month ago

What Provide a TTNN API to return Op perf estimate to the TT-MLIR optimizer. The goal of this issue is to do an end-to-end PoC and conclude what would be the proper solution. Based on the conclusion we will open a new issue to define the whole work.

PoC Initially, on an example of MNIST NN and all Ops that are parts of MNIST, do the following tasks:

The above tasks should be done Iteratively until it works well for both TT-MLIR Optimizer and TTNN.

rjakovljevicTT commented 1 month ago

We know it would be a lot of complex work to provide and maintain "Op perf" API with Ops being actively developed and optimized, hence we should also explore potential alternatives in terms of how Optimizer would make performance related decisions. This is to be discussed at least with @s-jovic, @pavlepopovic, @nobradovictt.