We just has a chat about this. I was trying to merge two kmerge files of about 450-500MB each. I ran out of memory on a 32GB machine. I have a feeling you could do merging with a lot less memory if you did some memory mapping or if you held the kmers in memory but only used a reference to the bitstring for the alleles.
You might be able to do something similar to make the align use a lot less memory but I'm less sure.
We just has a chat about this. I was trying to merge two
kmerge
files of about 450-500MB each. I ran out of memory on a 32GB machine. I have a feeling you could do merging with a lot less memory if you did some memory mapping or if you held the kmers in memory but only used a reference to the bitstring for the alleles.You might be able to do something similar to make the align use a lot less memory but I'm less sure.