Apparent memory leak in ParticleTrackGalaxyFinder.get_galaxy_identification_loop_parallel()

zhafen / linefinder

A tool for finding and classifying the worldlines of Lagrangian parcels of mass, in the context of hydrodynamic simulations of galaxy formation.

https://zhafen.github.io/linefinder

MIT License

0 stars 1 forks source link

Apparent memory leak in ParticleTrackGalaxyFinder.get_galaxy_identification_loop_parallel() #70

Closed zhafen closed 6 years ago

zhafen commented 6 years ago

Originally reported by Zachary Hafen (Bitbucket: zhafen, GitHub: zhafen)

After running for a short while (~180 seconds on 5 processors), the galaxy finder crashes on Quest. It works fine on Stampede though.

Bitbucket: https://bitbucket.org/zhafen/pathfinder/issue/70

zhafen commented 6 years ago

Original comment by Zachary Hafen (Bitbucket: zhafen, GitHub: zhafen)

Resolved by parallelizing things through jug instead.

zhafen commented 6 years ago

Original comment by Zachary Hafen (Bitbucket: zhafen, GitHub: zhafen)

This memory leak seems to be particular to the exact way I parallelize the galaxy finding, so it might be worth just changing how I parallelize things and seeing if it's still an issue.