tenstorrent / tt-buda

Tenstorrent TT-BUDA Repository
Other
210 stars 28 forks source link

[Buy hardware](https://tenstorrent.com/cards/) | [Discord](https://discord.gg/tenstorrent)

tt logo **TT-Buda** is a software stack that can compile AI/ML models from several different frameworks, and execute them on Tenstorrent hardware.

[TT-Buda Docs](https://docs.tenstorrent.com/pybuda/latest/index.html) | [Model Demos](https://github.com/tenstorrent/tt-buda-demos/tree/main/model_demos#models-support-table)


Introduction

The TT-Buda software stack can compile AI/ML models from several different frameworks such as PyTorch and Tensorflow, and execute them in many different ways on Tenstorrent hardware.

Note on terminology:

TT-Buda is the official Tenstorrent AI/ML compiler stack and PyBuda is the Python interface for TT-Buda. PyBuda allows users to access and utilize TT-Buda's features directly from Python. This includes directly importing model architectures and weights from PyTorch, TensorFlow, ONNX, and TFLite.

Model Demos

Model demos are now part of a separate repo:

https://github.com/tenstorrent/tt-buda-demos

Docs

See: Docs

Build

See: TT-Buda Installation

Env setup

Set LD_LIBRARY_PATH to the location of third_party/budabackend/build/lib - preferrably the absolute path to allow scripts to find them from anywhere.

Silicon

See README.silicon.md for details on how to run on silicon.