NationalGenomicsInfrastructure / anglerfish

Anglerfish - Nanopore reads from Illumina libraries
MIT License
2 stars 4 forks source link

Support for multiprocessed fastq output #65

Closed remiolsen closed 6 months ago

remiolsen commented 7 months ago

closes #3

Parallelise per fastq file output (and not fastq file entries chunks). I will not explain further.

Needs some testing. Setting this as draft PR

remiolsen commented 6 months ago

Also updated to ruff 0.3.0 for ruff-precommit, since the old one was fighting with GH action's version of ruff.

remiolsen commented 6 months ago

I changed my mind. I might as well try to parallise lenient mode while I'm at it.

remiolsen commented 6 months ago

closes #50

I'm satisfied that my multiprocessing.spawn usage works on OSX and Linux (Miarka). Hopefully it will not cause Windows to explode and catch fire.

Ready for review now @alneberg