search

mctools / mcpl

Monte Carlo Particle Lists
https://mctools.github.io/mcpl/
Other
29 stars 13 forks source link

Use sendfile functionality for super-fast merges #17

Closed tkittel closed 1 year ago

tkittel commented 7 years ago

Using sys/sendfile.h on linux (once all kernels are >= 2.6.33, which unfortunately excludes slc6, or if at some point the presence of the functionality can be easily inferred), it could in principle be possible to dramatically speed up merges of very large files. Destructive/inplace merges could even benefit if there is a "move operator" version of this.

Not urgent at all, but leaving it as an idea for a possible improvement far in the future.

tkittel commented 1 year ago

Closing since I honestly don't think anyone is currently limit by merging efficiency.