mhoban / rainbow_bridge

GNU General Public License v3.0
5 stars 2 forks source link

Streamline process execution for optimal parallelism #89

Closed mhoban closed 3 months ago

mhoban commented 3 months ago

There are a few cases still where commands will be executed multiple times per process (.e.g., for multiple barcode files). This could be improved with better parallelism and process flow. This may require some restructuring of the pipeline but I think it would be worth it because it would improve parallelism and potentially speed things up across the board.

mhoban commented 3 months ago

This will be especially relevant as the pipeline is updated to allow a combination of both illumina indices and barcoded primers.

mhoban commented 3 months ago

I"m gonna combine this together with #82, since it involves both things