Closed xcode03 closed 11 months ago
This configuration is documented here: https://docs.nvidia.com/datacenter/cloud-native/gpu-telemetry/latest/dcgm-exporter.html#connecting-to-a-dcgm-standalone-container. It is possible by having the dcgm-exporter container connect to the DCGM nv-hostengine/API container.
In addition, would you like to ask whether configuring this parameter on a100 will affect dcgm collection? @glowkey
# /etc/modprobe.d/ncu.conf
options nvidia NVreg_RestrictProfilingToAdminUsers=0
@xcode03,
That parameter controls whether collecting DCP metrics (1001-1014) on GV100/GA100 GPUs would require root permissions. DCP metrics on architectures before GH100 are using the profiling capabilities. If you set NVreg_RestrictProfilingToAdminUsers=0, nv-hostengine does not need root privileges to collect DCP metrics.
On a GPU physical machine, there are two containers: dcgm-exporter and the dcgm api program. When running the latter, I received the following error:
Is there a way for both to coexist?