search

getsentry / sentry-python

The official Python SDK for Sentry.io
https://sentry.io/for/python/
MIT License
1.93k stars 510 forks source link

Investigate profiling with sys.monitoring/PEP 669 #2683

Open DragoonAethis opened 10 months ago

DragoonAethis commented 10 months ago

Problem Statement

Sentry's built-in profiling is reasonably low-overhead, but it takes a snapshot of the app's stack every ~10ms. This can miss quite a lot of events. Before Python 3.12, implementing a more comprehensive profiler would tank performance and was absolutely cost-prohibitive in production.

Solution Brainstorm

But since 3.12 we have PEP 669 and sys.monitoring, a low(er)-overhead method of getting access to interpreter events. These allow informing a profiler whenever a new interpreter event happens in process. It'd be nice to investigate if this could be used for more granular Python profiling.

sentrivana commented 10 months ago

Hey @DragoonAethis, thanks for the suggestion. sys.monitoring does indeed look interesting for 3.12+.

cc @Zylphrex

Zylphrex commented 10 months ago

Thanks for the suggestion. This is something on our radar but there are no definite timelines yet. 👍

DragoonAethis commented 10 months ago

Sure! I don't expect anything about this, consider this ticket just as a tracker for interested people :)