NNPDF / pineappl

PineAPPL is not an extension of APPLgrid
https://nnpdf.github.io/pineappl/
GNU General Public License v3.0
13 stars 3 forks source link

Improve convolution time #11

Closed cschwan closed 4 years ago

cschwan commented 4 years ago

The subcommand convolute of pineappl needs roughly 8.5 seconds on cigno for the convolution of CMSDY2D11 with a PDF set. Roughly two thirds of the time is spent loading the grid (about 800 MB large), but the remainder is spent convoluting. The latter should be optimized by caching the luminosity function.

cschwan commented 4 years ago

Commit ee6135742758f2e5cc30f8722f1a1e85a320b36f improves the convolution time by roughly 20%.

cschwan commented 4 years ago

Commit fd8f1ba68287c11640c29349e56c2e99a41723ea cuts down the time to load the file, but changes the file format.

cschwan commented 4 years ago

For a simple (?) speedup we can use multi threading to perform different convolutions in parallel.

cschwan commented 4 years ago

Commit eadba9e1993810500690ac8ff0c85a6b04850e0b uses rayon to speed up the calculation of PDF uncertainties in pineappl. The parameter --threads can be used to select the number of threads.

cschwan commented 4 years ago

Commits 03d2d2337841ef4b6b9a275bd1ea8e50a6ded16b and 22572736a28ee650cb7398559ce2b46c4b1add05 improve the performance of CMS_Z_13TEV by roughly 70%.

cschwan commented 4 years ago

Commit f71e29467ed10c02421e88f12913bba47e3be58d improves the performance of CMSDY2D11 by another 50%.

cschwan commented 4 years ago

Commit 007a835e38d9078d34079c520e914c5c58aadaad improves the performance of CMSDY2D11 by yet another 25% for a 9-point scale variation.