Closed steven-albanese closed 8 years ago
First, check if you can run nvcc
on those nodes:
ssh gpu-2-12 nvcc --version
If not, your module environment may not have CUDA 7.0 uniformly selected. My ~/.modulerc
is:
[chodera@mskcc-ln1 ~albaness]$ cat ~/.modulerc
#%Module
module remove gcc
module add cmake
module add cuda/7.0
module add gcc
This could also be a red herring and there could be some other error causing files to be closed early that is being reported as a Bad file descriptor
error.
I think it was a problem with my module environment, since I hadn't configured that at all. With your .modulerc, it seems to be working at the moment. Thanks!
Yeah, I just ran the explicit refinement step, no problems at all!
Trying to run the implicit refinement in parallel on the cluster using the following script:
It's modified from @sonyahanson's in dansu-dansu. I seem to be having some trouble with only a small subset of the processes. The log is shown below.
Is this a problem with my clusterutils setup? It looks like the errors are with cuda on only certain nodes.