search

USCbiostats / slurmR

slurmR: A Lightweight Wrapper for Slurm
https://uscbiostats.github.io/slurmR/
Other
58 stars 12 forks source link

[JOSS review] Comparison table #16

Closed mllg closed 5 years ago

mllg commented 5 years ago

This is a part of the JOSS review outlined in openjournals/joss-reviews#1493.

The comparison table in the readme says that batchtools cannot re-run jobs, but batchtools is perfectly capable of it:

library(batchtools)
reg = makeRegistry(NA)
f = function(x) if (x == 3) stop(3) else x^2
btlapply(1:5, f, reg = reg)
# -> no result

# partial results are available in registry
reduceResultsList()

# re-submit failed jobs
# (job #3 will fail again of course, just for demonstration)
submitJobs(findErrors())
gvegayon commented 5 years ago

Didn't know that (nice feature! May hijack the concept/name for sluRm). As I said it before, the comparison table was built "to the best of my knowledge". More than happy to keep working on that. Sidenote, perhaps this can be a project of its own, like R4HPC or something. Not sure if there's something like that around, but perhaps having a git(hub) resource for general HPC with R may be useful (thoughts?).

mllg commented 5 years ago

Sidenote, perhaps this can be a project of its own, like R4HPC or something. Not sure if there's something like that around, but perhaps having a git(hub) resource for general HPC with R may be useful (thoughts?).

I'm not aware of something like this. Might be a worthwhile endeavor.