Tang-Lab-super / PROST

PROST: A quantitative pattern recognition framework for spatial transcriptomics.
MIT License
5 stars 1 forks source link

How to control to MEMORY used by PROST #2

Closed cchd0001 closed 2 months ago

cchd0001 commented 3 months ago

Hi,

Thanks for developing this useful package.

Here is my issue: I got an data of 133,350 cells with 20,000 genes . In an machine with 500GB memory I run the PROST function but failed by "Unable to allocate" image

Is there anyway to limit the memory cost of PROST ? Or how many memory should I prepare for this dateset ?

Thanks Lidong GUo

Sicrve11 commented 2 months ago

Thanks very much for your feedback about memory usage, this is one of our shortcomings as we use an adjacency matrix approach when building graph neural networks, which results in slower runs and heavier memory burden on larger datasets. We might improve it at a later stage by using sparse matrices or by using DGL.

I see that you are using the function spatial_autocorrelation, you may be able to mitigate this by reducing the size of the permutations.

cchd0001 commented 2 months ago

Thanks, I will try permutations