Diagnosing memory issues in Python extensions

spacetelescope / braindump

A place to collect notes from code discussions

2 stars 5 forks source link

Diagnosing memory issues in Python extensions #30

Closed drdavella closed 4 years ago

drdavella commented 6 years ago

In case it is of interest, I have prepared short demos on the following topics:

detecting memory leaks in Python extensions using valgrind
detecting buffer overruns in Python extensions using address sanitizer

Let me know if there are other topics that would be of interest. These might include using gdb to debug Python extensions, detecting undefined C behavior in extensions, etc.

pllim commented 6 years ago

So this is specific to only C-extensions? Can we apply the same tools to Cython?

drdavella commented 6 years ago

I'm not really familiar with Cython to be honest. Does it have the same issues as C in terms of memory management?

pllim commented 6 years ago

Hmm maybe @eteq can comment. I never have to venture into Cython-land yet, for better or worse.

pllim commented 6 years ago

That was a great talk! Any chance memleak, segfault, and all the magical incantations would be added to this repo or somewhere?

drdavella commented 6 years ago

Right now I have it in https://github.com/drdavella/debugging, but it's not well documented. I'll work on improving it when I find a bit of time.