NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
749 stars 221 forks source link

[FEA] Use `cudf::io::config_host_memory_resource` #10814

Open abellina opened 1 month ago

abellina commented 1 month ago

Filing this as P0 to call the new config_host_memory_resource api in 24.06 so we can disable an extra pinned allocation that would happen otherwise.

We will want to revisit our pinned pool MR in 24.08+ to align closer to the whole-cuDF pinned pool.