Closed Psychomachia closed 5 days ago
Thank you for your wonderful technology. When running scripts/stage1_pretrain.sh,
NNODE=$(scontrol show hostnames "$SLURM_JOB_NODELIST" | wc -l) MASTER_ADDR=$(scontrol show hostnames "$SLURM_JOB_NODELIST" | head -n 1) NODE_RANK=$(($(scontrol show hostnames "$SLURM_JOB_NODELIST" | grep -m 1 -Fn $(hostname) | cut -d ":" -f1)-1))
Does this mean that I need to set up the SLURM environment? Sorry for my bad English. Tahnk you!!
Thank you for your wonderful technology. When running scripts/stage1_pretrain.sh,
ddp realted
NNODE=$(scontrol show hostnames "$SLURM_JOB_NODELIST" | wc -l) MASTER_ADDR=$(scontrol show hostnames "$SLURM_JOB_NODELIST" | head -n 1) NODE_RANK=$(($(scontrol show hostnames "$SLURM_JOB_NODELIST" | grep -m 1 -Fn $(hostname) | cut -d ":" -f1)-1))
Does this mean that I need to set up the SLURM environment? Sorry for my bad English. Tahnk you!!