Closed mschubert closed 4 years ago
@mstr3336 I've updated the PBS scheduler to produce cmq-specific default log names, using $PBS_ARRAY_INDEX
as per PBS User Guide, page 160. Can you confirm this works?
remotes::install_github("mschubert/clustermq", ref="develop")
clustermq::Q(function(x) x*2, x=1:5, n_jobs=1, log_worker=T) # should create cmqXXXX-1.log in $(pwd)
Looks awesome, I'll test it out on the HPC soon
This all concerns the
develop
branch and should not impact users onmaster
or the stable CRAN release.issue withQ(... template=list(...))
does not submit jobs~
expansion on log files, usingnormalizePath
to avoidCtrl+c hangs when used to interrupt pollingwas locked in compiled code for excessive memory test, beyond the scope of this releasemultiprocess
test is "unable to terminate some child processes" (cf. e.g. https://github.com/r-lib/processx/issues/240, https://github.com/r-lib/processx/issues/236)Test on Windowscan not testmulticore
,callr
together because of https://github.com/r-lib/processx/issues/236QSys
automatically adding log splitters (e.g.%a
on Slurm)rzmq
qsys_impl
tests do not create logs with CRAN testsCheck #199Optional
multicore
(#169),multiprocess