mschubert / clustermq

R package to send function calls as jobs on LSF, SGE, Slurm, PBS/Torque, or each via SSH
https://mschubert.github.io/clustermq/
Apache License 2.0
145 stars 26 forks source link

Memory options missing from SGE template #298

Closed nickholway closed 1 year ago

nickholway commented 1 year ago

The memory flag in the Q function has no entry in the SGE (ie AGE / UGE) template file which means that no memory requests are passed through to SGE.

I'm on R4.2.1 and Clustermq 0.8.95.3. Full Session info:


R version 4.2.1 (2022-06-23)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: CentOS Linux 7 (Core)

Matrix products: default
BLAS/LAPACK: /usr/prog/FlexiBLAS/3.0.4-GCC-11.2.0/lib64/libflexiblas.so.3.0

locale:
 [1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C               LC_TIME=en_US.UTF-8        LC_COLLATE=en_US.UTF-8     LC_MONETARY=en_US.UTF-8   
 [6] LC_MESSAGES=en_US.UTF-8    LC_PAPER=en_US.UTF-8       LC_NAME=C                  LC_ADDRESS=C               LC_TELEPHONE=C            
[11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C       

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] clustermq_0.8.95.3

loaded via a namespace (and not attached):
 [1] compiler_4.2.1   fastmap_1.1.0    cli_3.4.0        htmltools_0.5.3  tools_4.2.1      rstudioapi_0.14  yaml_2.3.5       Rcpp_1.0.9      
 [9] rmarkdown_2.15   codetools_0.2-18 knitr_1.40       xfun_0.33        digest_0.6.29    rlang_1.0.6      evaluate_0.16   ```
mschubert commented 7 months ago

@nickholway what version of SGE were you using?

I've run tests on 8.1.9 and it didn't recognize the m_mem_free option. The docs I found also mentioned mem_free and not m_mem_free.

nickholway commented 7 months ago

We're on a slightly old version of UGE, 8.6.4. Looking at the Man page for it, m_mem_free is mentioned in it.

mschubert commented 7 months ago

Thanks! I found it in some other docs as well, so we'll keep it as a default.