compomics / ms2rescore

Modular and user-friendly platform for AI-assisted rescoring of peptide identifications
https://ms2rescore.readthedocs.io
Apache License 2.0
39 stars 14 forks source link

DeepLCFeatureGenerator multiprocessing issue when number of processes is more than 1 #151

Open vrkosk opened 1 month ago

vrkosk commented 1 month ago

When I run DeepLCFeatureGenerator with processes=8, it takes a long time, much longer than processes=1. Python correctly starts 8 python.exe multiprocesses, but often the execution just hangs (I've waited more than 30 minutes -- using processes=1, it took less than 5 minutes). It's actually faster to run DeepLCFeatureGenerator with just processes=1 and it seems to work every time.

I can provide a test case if this isn't a known issue already.