We often have calls to np.asarray in the code, which make an immediate copy into memory even if the input array is a memory mapped array
Steps/Code to Replicate the Bug
On Linux (which has a pretty rigid management of RAM) generate_indices_of_segment_boundaries_unbinned fails when the input file is a memory map larger than the RAM
Description of the Bug
We often have calls to
np.asarrayin the code, which make an immediate copy into memory even if the input array is a memory mapped arraySteps/Code to Replicate the Bug
On Linux (which has a pretty rigid management of RAM)
generate_indices_of_segment_boundaries_unbinnedfails when the input file is a memory map larger than the RAMExpected Results
It should work.
Actual Results
It doesn't