Clinical-Genomics / genmod

Annotate models of genetic inheritance patterns in variant files (vcf files)
http://Clinical-Genomics.github.io/genmod/
MIT License
78 stars 19 forks source link

set abstract_sockets_supported to False #111

Closed ramprasadn closed 1 year ago

ramprasadn commented 1 year ago

Re-runs of genmod on the same cases when using singularity containers were crashing due to OSError

Screenshot 2023-08-26 at 14 00 20

Turns out this error is very likely to be caused by multiprocessing.Manager(), because its default socket address on Unix machines is not very random. So multiple containers on the same machine might be trying to access the same address resulting in memory conflicts. Changes proposed in this PR should fix that.

More info: https://stackoverflow.com/questions/74058016/how-do-you-run-multiple-aws-batch-jobs-with-multiprocessing-mp-manager-witho

Review:

This version is a:

ramprasadn commented 1 year ago

Thanks @torbjorgen 👍🏻