mschubert / clustermq

R package to send function calls as jobs on LSF, SGE, Slurm, PBS/Torque, or each via SSH
https://mschubert.github.io/clustermq/
Apache License 2.0
146 stars 27 forks source link

Expected PROXY_READY, recieve 'PROXY_ERROR: no file found' #267

Closed Aariq closed 3 years ago

Aariq commented 3 years ago

I've followed the setup guide and successfully used clustermq logged into the cluster, but now I'm trying to run it via SSH and I'm getting the following error:

library(clustermq)
#> * Option 'clustermq.scheduler' not set, defaulting to 'LOCAL'
#> --- see: https://mschubert.github.io/clustermq/articles/userguide.html#configuration
options(
  clustermq.scheduler = "ssh",
  clustermq.ssh.host = "<redacted@redacted.edu>, # use your user and host
  clustermq.ssh.log = "~/cmq_ssh.log" # log for easier debugging
)
fx = function(x) x * 2
Q(fx, x=1:3, n_jobs=1)
#> Connecting <redacted@redacted.edu> via SSH ...
#> Sending common data ...
#> Error in .subset2(public_bind_env, "initialize")(...): Expected PROXY_READY, received 'PROXY_ERROR: no file found'

Created on 2021-06-08 by the reprex package (v2.0.0)

I've got a SLURM template file on the cluster at ~/slurm_clustermq.tmpl and I've added the following to ~/.Rprofile on the cluster:

options(
  clustermq.scheduler = "slurm",
  cluster.template = "~/slurm_clustermq.tmpl"
)
mschubert commented 3 years ago

Just to confirm, does your call work when you run it directly on the cluster? Can you post the output?

(because your error likely says that the remote process does not find its template file, which should show up there as well)

And you're logging your proxy with clustermq.ssh.log = "~/cmq_ssh.log", can you show the log?

Aariq commented 3 years ago

Ah, you're right, the template wasn't being found. I had a typo in my template file name 🤦🏻‍♂️. Thanks!