Mayrlab / scUTRquant

Bioinformatics pipeline for single-cell 3' UTR isoform quantification
https://Mayrlab.github.io/scUTRquant
GNU General Public License v3.0
14 stars 3 forks source link

Support parallelized MTX loading #58

Closed mfansler closed 1 year ago

mfansler commented 1 year ago

This dramatically improves load times for large, multi-sample datasets destined for HDF5 output. This does not update the default threads or memory usage for the non-HDF5-backed mode of output. For now, we assume that those with large datasets will use HDF5 mode, and smaller datasets can continue using the default mode.

There could be benefits to the default mode for multi-sample settings, but we have not benchmarked this.

Closes #57