search

ksauby / ACSampling

MIT License
1 stars 0 forks source link

calculateJointInclusionProbabilities - troubleshoot memory issues #4

Closed ksauby closed 7 years ago

ksauby commented 7 years ago

is there a way to add up the joint inclusion matrices iteratively during the simulations to not be taking up so much memory? At least that is what I think is taking up all of the memory.

mcxman commented 7 years ago

If I understand correctly, you should be summing as you go. No?

On Apr 23, 2017 6:32 PM, "Kristen Sauby" notifications@github.com wrote:

is there a way to add up the joint inclusion matrices iteratively during the simulations to not be taking up so much memory? At least that is what I think is taking up all of the memory.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/ksauby/ACS/issues/4, or mute the thread https://github.com/notifications/unsubscribe-auth/ANkBsMJrhv7VJOUpD9LgF2g-dVjvitxeks5ry9GSgaJpZM4NFj3p .

ksauby commented 7 years ago

Oh, I didn't realize you were receiving notifications about this! For each simulation I'm saving a matrix giving 0/1 indicating if two networks were/were not included in the same sample. For some reason it has been taking up LOTS of memory (GBs) and I can only run ~ 100-200 simulations per population per sample size at a time. I'm not sure how to sum as I go but I will look into that possibility.

mcxman commented 7 years ago

I got about 4 emails today. If you can unsubscribe me that would be nice.

On Apr 23, 2017 7:47 PM, "Kristen Sauby" notifications@github.com wrote:

Oh, I didn't realize you were receiving notifications about this! For each simulation I'm saving a matrix giving 0/1 indicating if two networks were/were not included in the same sample. For some reason it has been taking up LOTS of memory (GBs) and I can only run ~ 100-200 simulations per population per sample size at a time. I'm not sure how to sum as I go but I will look into that possibility.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ksauby/ACS/issues/4#issuecomment-296497719, or mute the thread https://github.com/notifications/unsubscribe-auth/ANkBsENBR6kdOH-QCj9zEnqtVbjUvwR2ks5ry-MKgaJpZM4NFj3p .