Syllo / nvtop

GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm
Other
7.95k stars 291 forks source link

GPU Clock Rate should reflect higher of Graphics or Application Clocks (or provide option) #113

Closed Aea closed 2 years ago

Aea commented 3 years ago

nvtop appears to report Graphics Clock Speed which makes it somewhat inappropriate for use with non-graphics tasks.

If this is already implemented behavior then I may have encountered a bug.

Screen Shot 2021-07-07 at 17 23 01

Screen Shot 2021-07-07 at 17 18 49

NVIDIA-SMI 465.19.01 Driver Version: 465.19.01 CUDA Version: 11.3

Syllo commented 3 years ago

Hi,

I released a patch so that the clock speed shown by nvtop is the maximum between the Streaming Multiprocessor clock (which is used by cuda kernels) and the Graphical clock. Maybe this will help.

But from what I can see in your log, both SM and Graphics are at 420Mhz, which is the value shown by nvtop so I am not sure if there was a problem in your case.

The code uses nvmlDeviceGetClockInfo, which returns the current clock speed. From what I understand from the documentation, the "Application Clocks" is the target speed for application, which might be lower or higher in practice depending on boost/throttle mechanisms. I am not 100% certain about this so feel free to tell me if I get the whole "Application Clocks" wrong.

Syllo commented 2 years ago

Closing for inactivity. Feel free to re-open if you still encounter this issue.