Nvidia provides several tools to get usage statistics from the GPU, such as nvprof and nvvp. We should try to measure things such as processor usage, memory usage, and how much time is spent doing computation vs communication. We can do this for Palmetto nodes and the Jetson.
We can also do all of these things for CPU if we're curious. The wiki has instructions on CPU profiling with gprof.
Nvidia provides several tools to get usage statistics from the GPU, such as
nvprofandnvvp. We should try to measure things such as processor usage, memory usage, and how much time is spent doing computation vs communication. We can do this for Palmetto nodes and the Jetson.We can also do all of these things for CPU if we're curious. The wiki has instructions on CPU profiling with
gprof.