mobie / spatial-transcriptomics-example-project

An example project for spatial transcriptomics data
0 stars 0 forks source link

Multi-threading #28

Open tischi opened 1 year ago

tischi commented 1 year ago

Usually I over-commit with 16 threads for BDV rendering and fetching of the sources. My mac only has 4 workers.

But for the kdTree based sources I am unsure now, because there it actually needs to compute something. I cannot separate this out, there is only one number of threads for the rendering.

My feeling is to just use Runtime.getRuntime().availableProcessors() - 1 for everything now even if it may be a bit slower, because I am afraid things may hang if there are too many threads?!

What do you think?

constantinpape commented 1 year ago

Can you check beforehand if we have spot sources and oversubscribe if we don't have any?