hms-dbmi / scde

R package for analyzing single-cell RNA-seq data
http://pklab.med.harvard.edu/scde
Other
172 stars 66 forks source link

Memory usage with multithreading #35

Closed traversc closed 7 years ago

traversc commented 7 years ago

When we used SCDE on a dataset with multiple cores, we noticed there seemedd to be an issue with high memory usage. I think this is related to a long-standing bug in R parallelization here: https://github.com/tdhock/mclapply-memory

I modified the parallelization loop in scde's calculate.individual.models function: traversc@be34c81

This seemed to reduce memory usage for us when run on 40 cores.