implement parallel processing?

Nanostring-Biostats / InSituType

An R package for performing cell typing in SMI and other single cell data

Other

22 stars 10 forks source link

implement parallel processing? #169

Closed patrickjdanaher closed 1 year ago

patrickjdanaher commented 1 year ago

The computationally heavy part - running Mstep over thousands to millions of cells - can be parallelized. Can we take advantage of this? @davidpross - lmk what you think.

davidpross commented 1 year ago

I think the place to try parallelization in Mstep is for each profile.

davidpross commented 1 year ago

Implemented to call mclapply on ADO. Will not parallelize on Windows. Parallelized calls to lldist for each profile in the following places:

benchmarking subset insitutype.R:256
insitutypeML.R:66
chooseClusterNumber.R:85
M step nbclust.R:76

@patrickjdanaher For the locations other than M step do you have any specific recommendations for testing the updates?