benfred / py-spy

Sampling profiler for Python programs
MIT License
12.16k stars 401 forks source link

Sampling traces from multiple runs #524

Open chebbyChefNEQ opened 1 year ago

chebbyChefNEQ commented 1 year ago

Hi folks,

I have a similar question to #476.

Say that I would be recording thousands if not tens of thousands of processes. Concatenating the files might yield major size and processing time increase. Is there a way to subsample raw files?

Why not just sample at a lower rate? It would be nice to have both high level aggregation across the fleet and single job drilling down.

Thank you! <3