-
Create an example using multiple nodes on a Slurm cluster to run a simulation.
-
Hi, amazing resource of tools built here!
I have a question regarding the seqParallel function. I can see the `cl` arguement takes a BiocParallelParam object. I attempted to use it with a [Batchtoo…
-
It could be useful to add a parallel backed to preprocess... Operations can be parallelized throught columns and it could be helpful in estimation and prediction expecially when the data set has many …
-
On a cluster that I'm using, `sbatch` prints multiple outputs. So, e.g., `reg$status$batch.id` always returns incorrect **batch.id** which further causes some difficulties (e.g., cannot distinguish ru…
-
https://hpc.nih.gov/docs/job_dependencies.html
-
I want to run a loop in parallel on a SLURM cluster and use `progressr` to output near-live updates. Here's my setup:
### test.R
```r
library("future")
library("furrr")
library("progressr")
…
-
Late suggestion, but I would be interested in discussing how R can be used on high-performance clusters. In my case that's a university cluster, but I imagine people are doing this in lots of differen…
-
Let's use this issue / thread to troubleshoot what looks like `rna.rsem_count` crashing compute nodes. I'll start off by adding my notes from the past related to this.
BTW, whenever you see "I w…
-
Hi !
In the GSVA() function, we can use the parallel.sz argument to parallelize the task on multiple cores. This works really well but it limits you to the number of core available on your computer…
-
I am using batchtools to run a simulation study for which I have a lot (18 million) of very short jobs. I chunk those jobs into 100 jobs, which makes them run quite fast on our cluster (around 24hs fo…