caitiecollins / treeWAS

treeWAS: A Phylogenetic Tree-Based Tool for Genome-Wide Association Studies in Microbes
Other
92 stars 18 forks source link

memory error #69

Open DorothyTamYiLing opened 1 year ago

DorothyTamYiLing commented 1 year ago

Hi Caitie,

I am using treeWAS in this dataset of 3000-4000 samples and 229626 unitigs. I kept running into memory error even after I adjusted the chunk size (I have tried 30 and 120 chunks and it stopped at 4 and 33 chunks respectively). I have also tried setting mem.lim flag stating my available memory (50G) and it was running in 44 chunks, but also stopped after a couple.

Do you have a way that I can make treeWAS run without running into memory error?

I have indeed run treeWAS in batches of unitigs (23 batches each with 10000 unitigs), do you think this is a good idea for using treeeWAS, in term of how it decides the significance and multiple testing correction?

Thanks, Dorothy