tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
Apache License 2.0
413 stars 52 forks source link

Complete customer team trial installation of wheel after `patchelf` and related cleanup for metal wheel `v0.52.0-rc21` #12609

Open tt-rkim opened 2 weeks ago

tt-rkim commented 2 weeks ago

Please refer to https://github.com/tenstorrent/tt-metal/releases/tag/v0.52.0-rc21

This is a release candidate. We generate these every night.

Please note:

Let us know if we should put any of this in the installation instructions.

Let us know of any other specific feedback to take action on. Otherwise, we will consider there to be no action items on infra or metal team.

Let us know if you have any further questions.

cc: @TT-billteng

dvartaniansTT commented 1 week ago

@tt-rkim I confirm falcon7b model demo passes. and the WHL installation was smooth. but all models demos need to pass for an official WHL release as we see in the CI some model demos failed.

The detailed instructions added to the issue description such as following the installation guide from the whl branch/tag ... the note regarding env variables setting, ... should be added to the installation instructions for the customers as well. cc: @mbahnasTT

tt-rkim commented 3 days ago

@uaydonat @skhorasganiTT Note that customer team is raising the issue of not all model demos passing on an official release.

The official position of the models team is it will NOT be a release-level goal to ensure that all models function for the same release candidate wheel, while at the same time advertising the latest and greatest performance numbers for all the models. The only guarantee the models team will deliver for the time being is that functioning individual models can be tied to specific release candidates (NOT non-release official releases). So, users on the front page will know which model works on which release candidate, but it won't necessarily be the same one for all models. @uaydonat can elaborate.

I have personally urged model team to treat breaking model demos as P0.

tt-rkim commented 3 days ago

Thank you for your feedback @dvartaniansTT . If you believe the instructions for wheel were sufficient, then we can close the instructions changes issue for the wheel as well.