XuehaiPan / nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
https://nvitop.readthedocs.io
Apache License 2.0
4.56k stars 144 forks source link

[Feature Request] Add support for PCIE throughput and NVLink throughput #82

Closed lungothrin closed 1 year ago

lungothrin commented 1 year ago

Required prerequisites

Motivation

It would be nice to be able to monitor throughput between CPU & GPU, and that between different GPUs.

like in Jupyter Lab - GPU dashboards, https://developer.nvidia.com/blog/gpu-dashboards-in-jupyter-lab/

Solution

No response

Alternatives

No response

Additional context

No response

XuehaiPan commented 1 year ago

Hi @lungothrin, thanks for raising this. It would be a great feature.

I have added initial results for new query APIs in PR #87.

Now you can implement your own throughput monitor tools based on that if the PR is merged.

However, for the nvitop CLI, there may be no space left to add information for "PCI-e TX/RX" and "NVLink TX/RX". Any thought?