How to specify another GPU to run rather than cuda:0?

huggingface / alignment-handbook

Robust recipes to align language models with human and AI preferences

https://huggingface.co/HuggingFaceH4

Apache License 2.0

4.28k stars 367 forks source link

Closed njupopsicle closed 7 months ago

njupopsicle commented 7 months ago

I tried to modify the --gpu_ids paramater in recipes/accelerate_configs/multi_gpu.yaml, however, it didn't work, the device was still 'cuda:0'.

njupopsicle commented 7 months ago

I was a shabi. Now I know.