Granulate / gprofiler

gProfiler is a system-wide profiler, combining multiple sampling profilers to produce unified visualization of what your CPU is spending time on.
https://profiler.granulate.io
Apache License 2.0
745 stars 54 forks source link

NVIDIA GPU profiling support #625

Open elgalu opened 1 year ago

elgalu commented 1 year ago

Feature Request

Support for GPU profiling similar to what's currently being offered for CPU.

Alternative solutions

  1. Sentry's (OSS) OpenTelemetry Collector collects GPU metrics
  2. Framework-specific like PyTorch Profiler or TensorFlow Profiler that could be incorporated into this product to provide it as a service out of the box.

Is there a use case or business reason for this request?

The CPU market is growing at a compound annual growth rate (CAGR) of 4.36% while the GPU market grows at a CAGR of 33.4%. Also NVIDIA has the biggest market share at 80%.