rapidsai / wholegraph

WholeGraph - large scale Graph Neural Networks
https://docs.rapids.ai/api/cugraph/stable/wholegraph/
Apache License 2.0
100 stars 38 forks source link

allow users to choose shm allocation method for chunked/continous host memory #187

Closed linhu-nv closed 5 months ago

linhu-nv commented 5 months ago
  1. The default shm option is still SYSTEMV, but users can choose POSIX API through system env using export WG_USE_POSIX_SHM=1.
  2. unlink shm files immediately after shm_open to avoid leftover memory in /dev/shm in case of a wholegraph crash.
BradReesWork commented 5 months ago

/merge