KULeuven-MICAS / snax_cluster

A heterogeneous accelerator-centric compute cluster
Apache License 2.0
9 stars 8 forks source link

CI License

SNAX Cluster

This repository hosts the hardware and software for the SNAX cluster and its generator. SNAX is a high-efficiency compute cluster platform designed for computation- and data- intensive artificial intelligence workloads. It provides a standard SNAX shell for conveniently integrating versatile accelerators. The SNAX shell leverages CSR manager for programming the accelerators in the control plane and data streamers for data access in the data plane.

The figure below shows an architectural overview of the SNAX cluster.

image

SNAX supports several design-time and run-time configurations to support a variety of accelerators. For example, some design-time configurations include customizing the memory sizes, the interconnect structure connecting the accelerators to memory, the number of Snitch cores controlling accelerators, and so much more. For run-time configurations, we provide data streamers and reshufflers to aid accelerators in organizing data layouts in memory and managing data access patterns. SNAX is being co-developed with an MLIR-based toolchain, available at KULeuven-MICAS/snax-mlir

Getting Started

To get started, check out the getting started guide.

We provide a detailed tutorial on integrating an accelerator into the SNAX cluster platform.

Content

What can you expect to find in this repository?

Directory Structure

The project is organized as a monolithic repository. Both hardware and software are co-located. Standalone accelerators can have their own repositories and can be imported here using Bender.

The file tree is visualized as follows:

├── hw
│   ├── chisel
│   │   ├── csr_manager
│   │   └── streamer
│   ├── snax_accelerator_1
│   ├── snax_accelerator_2
│   ├── snitch_stuff
│   └── templates
├── sw
├── target
│   └── snitch_cluster
│       ├── config
│       ├── generated
│       └── sw
│           ├── apps
│           │   ├── snax_system_1
│           │   └── snax_system_2
│           └── snax_lib 
│               ├── snax_system_1
│               └── snax_system_2
└── util
    ├── clustergen
    └── wrappergen

The top-level is structured as follows:

Acknowledgement

SNAX is an extension of the original Snitch Cluster framework. SNAX got its name as "SNitch Acceleration eXtension".