Open liang1wang opened 8 months ago
Upload a log for: If only 1 arc700 installed, "Inference" is done but still see the err, thanks! "ERROR:torch.distributed.elastic.multiprocessing.api:failed" result_1a.txt
Hi, @liang1wang , as we synced offline, please try to use mpirun
instead of torchrun
, take the example script for example.
Case: BigDL/python/llm/example/GPU/Deepspeed-AutoTP Model: Llama-2-7b-hf ARC770: 2 cards env: RPL RVP, ubuntu22.04, kernel-6.4.1, mem-32G oneAPI 23.2.0 Running result:
result_2a_1.txt