YosefLab / scone

53 stars 12 forks source link

Memory issues with parallel computing #76

Open drisso opened 8 years ago

drisso commented 8 years ago

The function and the environment in which it is defined are copied when using snow back-ends in BiocParallel. We define pretty large objects in the scone_main() environment and hence the memory usage can be very expensive. I would think that a potential solution is to break down scone_main() into smaller functions that have a more specialized role.