nod-ai / iree-amd-aie

IREE plugin repository for the AMD AIE accelerator
Apache License 2.0
69 stars 30 forks source link

HSA HAL for AIE #775

Closed makslevental closed 1 month ago

makslevental commented 2 months ago

This is the long-awaited HSA HAL for us (AIE). It should be considered beta - it all works (all the current tests pass, even on Strix) but there are probably still many "sharp edges". In addition, I haven't timed anything so I don't know if it's actually slower or faster than the XRT HAL.

There's a lot here if you haven't worked with IREE's HAL before or HSA before. So ask all the questions - investigating/answering them will help me clarify my own understanding as well.

Only thing to explicitly call out is that currently it's pinned to a branch of ROCr which will be merged as soon as I fix up the tests over there.

Note: only Linux (a current limitation of HSA itself).

Shout out to @eddierichter-amd for fighting in the trenches with me on this.

cc @stellaraccident @powderluv @kumardeepakamd @MaheshRavishankar