search

Alpha-VLLM / LLaMA2-Accessory

An Open-source Toolkit for LLM Development
https://llama2-accessory.readthedocs.io/
Other
2.7k stars 170 forks source link

Running SPHINX without SLRUM #161

Closed babla9 closed 5 months ago

babla9 commented 7 months ago

Hi, I'm trying to run this finetuning SPHINX script on a 8xV100 machine.

However, my machine doesnt have SLURM installed, so how do I allow the script to access all gpus on the cluster without using srun / slurm?

Thanks!

ChrisLiu6 commented 7 months ago

replace srun python xxx with torchrun --nproc_per_node=8 xxx should be all you need