eyalroz / cuda-api-wrappers

Thin, unified, C++-flavored wrappers for the CUDA APIs
BSD 3-Clause "New" or "Revised" License
766 stars 79 forks source link

Switch to cuMemAdvise_v2 with CUDA v12 and later #644

Open eyalroz opened 4 months ago

eyalroz commented 4 months ago

There's a new version of cuMemAdvise, named cuMemAdvise_v2, available since CUDA v12.2 . Let's support it. Plus, it will supplant cuMemAdvise with CUDA 13 - so let's prepare for that.

This one uses CUmemLocation, which we use with mem pools (hiding non-device locations).