search

compomics / ThermoRawFileParser

Thermo RAW file parser that runs on Linux/Mac and all other platforms that support Mono
Apache License 2.0
188 stars 50 forks source link

Convert using a configurable number of cores #23

Open azzamallow opened 5 years ago

azzamallow commented 5 years ago

When I run ThermoRawFileParser I notice it uses 2 cores (I think) while doing the conversion. I have a large machine that has many cores, and id like to use a configurable number of cores for the conversion.

To make use of all the cores on my machine I have written a script which executes many ThermoRawFileParser processes in parallel, so I have a solution to my problem. However, specifying the number of cores to use would make it easier for me to make full use of my machine and not require such a script.

nielshulstaert commented 5 years ago

Hi,

Thanks for your input. Do you mean providing a list of RAW files as an argument to the parser or processing a single RAW file in a multi-threaded way?

I know the Thermo library API has some multi-threaded methods but I didn't get around to using it in my code.

Best regards,

Niels

ypriverol commented 5 years ago

@nielshulstaert In this respect. We have done some performance comparisons with the previous proteowizard conversion and the previous Thermo Windows API was 6 times faster than our library. I will make this data available soon.

azzamallow commented 5 years ago

Sorry for the late response, I mean processing a single RAW file in a multi-threaded way.

Cheers.

Aaron

Hi,

Thanks for your input. Do you mean providing a list of RAW files as an argument to the parser or processing a single RAW file in a multi-threaded way?

I know the Thermo library API has some multi-threaded methods but I didn't get around to using it in my code.

Best regards,

Niels