Various small optimizations

CHIP-SPV / chipStar

chipStar is a tool for compiling and running HIP/CUDA on SPIR-V via OpenCL or Level Zero APIs.

Other

219 stars 32 forks source link

Closed linehill closed 5 months ago

linehill commented 6 months ago

... for reducing kernel launch host overhead.

Enable (optional) link-time optimizations for the libCHIP library.
Add early exits in couple functions.
Avoid redundant kernel argument copies. Along the way, fix CHIPGraphNodeKernel instances didn't copy kernel arguments fully (they only copied pointers to arguments but not their values).
Eliminate map lookups in SPVFuncInfo::visit*Args().

pvelesko commented 5 months ago

A test failed with what appears to be a race condition.