search

shuzhao-li-lab / asari

asari, metabolomics data preprocessing
Other
38 stars 9 forks source link

Parallelize Mass Grid Construction #71

Closed jmmitc06 closed 1 week ago

jmmitc06 commented 1 year ago

This is probably non-trivial.

jmmitc06 commented 1 week ago

The actual mass grid construction is quite fast, its loading the data from disk that is slow. The async file loader handles this partially, while a true multiprocessed solution would be even better. This is more easily handled at the sample loading / caching level not in the mass grid construction itself.