search

frankligy / scTriangulate

scTriangulate is a Python package to mix-and-match conflicting clustering results in single cell analysis and generate reconciled clustering solutions
MIT License
35 stars 5 forks source link

reduce memory usage for parallelization #17

Open frankligy opened 2 years ago

frankligy commented 2 years ago

https://github.com/Barski-lab/workflows/blob/master/tools/dockerfiles/scripts/sc_split_atac.py

instead of using pool, use shared_memory to reduce memory overhead

frankligy commented 2 years ago

also thinking about using dask for MPI across multiple cores