Closed AntoineBlanot closed 1 year ago
Previous issue proposed to run by: accelerate launch --num_processes xxx qlora.py --ddp_find_unused_parameters False ... But this actually do not work. (I tested with the llama2 branch). Do someone managed to make it work?
accelerate launch --num_processes xxx qlora.py --ddp_find_unused_parameters False ...
AntoineBlanot
commented
1 year ago
Previous issue proposed to run by:
accelerate launch --num_processes xxx qlora.py --ddp_find_unused_parameters False ...But this actually do not work. (I tested with the llama2 branch). Do someone managed to make it work?