nod-ai / iree-amd-aie

IREE plugin repository for the AMD AIE accelerator
Apache License 2.0
45 stars 23 forks source link

Command chaining #484

Open nirvedhmeshram opened 5 days ago

nirvedhmeshram commented 5 days ago

"Command Chaining" for AIE devices is a concept in XRT for efficient batched run of jobs. You add a list of xrt::run objects to a list and can execute the list together. That is more efficient. You can have N number of xrt::run objects in the list, but up to a maximum of 24 of them are bunched together to reduce overhead of ringing bell at mailbox etc. Here is an example https://github.com/Xilinx/mlir-aie/tree/main/programming_examples/basic/vector_scalar_add_runlist . We can have the iree XRT HAL driver do this too.