Open flowbywind opened 4 months ago
运行命令怎么写的
运行命令怎么写的
torchrun --nproc_per_node 8 example_text_completion.py --ckpt_dir Meta-Llama-3-70B-Instruct/ --tokenizer_path Meta-Llama-3-70B-Instruct/tokenizer.model --max_seq_len 512 --max_batch_size 8
any update lately?
用了8块a100-40g 运行llama3-70b-instruct 提示如下错误 [2024-04-22 10:52:15,696] torch.distributed.run: [WARNING] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. [2024-04-22 10:52:15,696] torch.distributed.run: [WARNING] *****