XuehaiPan / nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
https://nvitop.readthedocs.io
Apache License 2.0
4.56k stars 144 forks source link

[BUG] Missing process list on NVIDIA 535.98 driver #93

Closed yuzhiguo07 closed 1 year ago

yuzhiguo07 commented 1 year ago

Required prerequisites

What version of nvitop are you using?

1.2.0

Operating system and version

Ubuntu 22

NVIDIA driver version

535.98

NVIDIA-SMI

Mon Aug 21 16:34:25 2023       
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.98                 Driver Version: 535.98       CUDA Version: 12.2     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA GeForce RTX 2080 Ti     Off | 00000000:0A:00.0 Off |                  N/A |
| 40%   46C    P8              22W / 250W |      0MiB / 11264MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
|   1  NVIDIA GeForce RTX 2080 Ti     Off | 00000000:0B:00.0 Off |                  N/A |
|100%   69C    P2             249W / 260W |   9875MiB / 11264MiB |    100%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|    1   N/A  N/A    755511      C   python                                     9872MiB |
+---------------------------------------------------------------------------------------+

Python environment

3.11.3 (main, Apr 19 2023, 23:54:32) [GCC 11.2.0] linux nvidia-ml-py==11.525.131 nvitop==1.2.0

Problem description

there is a program running on GPU, but there is "No running processes found" in nvitop, but it is shown in nvidia-smi. image

Steps to Reproduce

The Python snippets (if any):

Command lines:

Traceback

No response

Logs

No response

Expected behavior

No response

Additional context

No response

XuehaiPan commented 1 year ago

Duplicate of #88. It is already fixed in the main branch.