On the HPC systems I look after the home folder is slow and small compared to the storage where file transfers usually take place. Would it be possible to add a command line parameter to specify where the chunks are written to?
An example use would be to use the ram disk on large memory nodes or to use parallel filesystems.
On the HPC systems I look after the home folder is slow and small compared to the storage where file transfers usually take place. Would it be possible to add a command line parameter to specify where the chunks are written to?
An example use would be to use the ram disk on large memory nodes or to use parallel filesystems.