Support for new dynamic parallelism API

JuliaGPU / CUDA.jl

CUDA programming in Julia.

https://juliagpu.org/cuda/

Other

1.2k stars 217 forks source link

Support for new dynamic parallelism API #2052

Open maleadt opened 1 year ago

maleadt commented 1 year ago

For https://github.com/JuliaGPU/CUDA.jl/issues/1846, we need to support and use the new dynamic parallelism API (CDP2). While the legacy API (CDP1) still works, there's a couple of things that don't on sm_90+:

calls to cudaDeviceSynchronize
querying or setting the LIMIT_DEV_RUNTIME_SYNC_DEPTH context limit

This new API was introduced in CUDA 12.

maleadt commented 3 months ago

Looks like the switch to CDP2 changed a lot in the device runtime (headers at cuda/targets/x86_64-linux/include/cuda_device_runtime_api.h). I haven't fully figured it out yet, but it looks like calls to e.g. cudaMalloc are now using new __cudaCDP2Malloc functions too.