I think this feature would help for MCWrapper jobs running on the ifarm. When the large chunks of simulated dataset output to /cache, it will be nice to have small size txt files to be sent to the /farm_out directory. I see this option taking logdir in other batch_systems already so it should be pretty straightforward to implement in swif2 as well. I will create a pull request to save this issue.
s6pepaul
commented
1 year ago
I think this feature would help for MCWrapper jobs running on the ifarm. When the large chunks of simulated dataset output to /cache, it will be nice to have small size txt files to be sent to the /farm_out directory. I see this option taking logdir in other batch_systems already so it should be pretty straightforward to implement in swif2 as well. I will create a pull request to save this issue.