ulissigroup / amptorch

AMPtorch: Atomistic Machine Learning Package (AMP) - PyTorch
GNU General Public License v3.0
59 stars 35 forks source link

Parallelization in fingerprint generation does not seam to work #105

Open vasalx opened 2 years ago

vasalx commented 2 years ago

When running the calculation as in examples, fingerprints are generated sequentially on a single processing core. Attempts to preprocess with AtomsData(..., cores=n) do not change the situation. The only option found until now is to use multiprocessing.Pool with structures submitted to AtomsData one by one (lists of length 1). This seems to generate the FP files but after that, errors out with

MaybeEncodingError: Error sending result: '[<amptorch.dataset.AtomsDataset object at 0x7f63509476a0>]'. Reason: 'TypeError("can't pickle _cffi_backend.__CDataOwn objects",)'

I am sorry for the unorganized report, but this is my first time. I will be glad to submit additional information as needed.