dnbaker / dashing2

Dashing 2 is a fast toolkit for k-mer and minimizer encoding, sketching, comparison, and indexing.
MIT License
62 stars 7 forks source link

Reduce memory usage in --parse-by-seq #81

Closed dnbaker closed 1 year ago

dnbaker commented 1 year ago
  1. Spill to disk sequences if necessary downstream; otherwise, remove them from memory when not needed.
  2. Add --seqs-in-ram option to do this in memory to trade RAM for time.
  3. Add to documentation.