Tall arrays with calcVariantGraph and clusterVariantGraph?

[nyyssont]

Is your feature request related to a problem? Please describe.

Computers with smaller amounts of memory struggle with the variant graph algorithm. I get emails from users who get errors like this:

There simply is not enough memory in certain machines to perform operations with large matrices, even when they are sparse.

Describe the solution you'd like

Is there any way to work with the large sparse matrices so that they are partially stored on the hard drive, in case there is not enough memory in Matlab. Like with tall arrays?

Propose a Syntax

This could be an option you set for the whole parentGrainReconstructor job class, like:

job.useTallArrays = true;

[nyyssont]

Well, the specific issue above was resolved by unchecking the box in the preferences related to virtual memory:

Maybe virtual memory can be used in all cases such as this? Perhaps someone more familiar with these kinds of issues could comment?