IBMSpectrumComputing / ray-integration

Ray with LSF. Users can start up a Ray cluster on LSF, and run DL workloads through that either in a batch or interactive mode.
Apache License 2.0
14 stars 2 forks source link

LSB_AFFINITY_HOSTFILE not set #18

Open adityamnk opened 3 months ago

adityamnk commented 3 months ago

Hi, I am using LSF on LLNL's Lassen cluster. Link is https://hpc.llnl.gov/hardware/compute-platforms/lassen. The script seems to require the environment variable LSB_AFFINITY_HOSTFILE to be set. But, this environment variable is not set on Lassen. My software engineering expertise and LSF knowledge is extremely limited. If you can help define and describe it, I can try contacting our local experts to find an appropriate equivalent setting on Lassen.

Thank you very much for any help.

asm582 commented 3 months ago

Please see details and sample file here: https://www.ibm.com/docs/en/spectrum-lsf/10.1.0?topic=variables-environment-variable-reference#LSBAFFINITYHOSTFILE345__title__1