Open jfx319 opened 4 years ago
loompy fromfq
wrapper versus kb count
wrapper (on the same dataset, same ref index files, same hardware, same kallisto & bustools binary versions). It didn't seem like kallisto was able to leverage the extra cpu's, so for the kb count run, I reduced it to 8 threads, and since kallisto doesn't use that much memory, I also added a max mem parameter of 20g (was run on the same node though).
perhaps a refactoring of the
fromfq
andcreate_from_fastq
is overdue given the updates to kallisto, bustools, and kb wrapper.Removing redundant reads using UMIs
step), which can easily trigger oom job failures that the user can't do much to control--tmp
flag that can help with #119As the kb ecosystem gets better, it will probably be easier to just leverage their maintained
--workflow
since their goals are aligned with improving performance. However, the additional perspective from the loompy parsing demonstrates other useful metadata that could be parsed out, and demonstrates how to store it into the loompy object, which the kb tutorials don't always pay as close attention to.