= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 0 PID 2425 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 1 PID 2426 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 2 PID 2427 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 3 PID 2428 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 4 PID 2429 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= RANK 7 PID 2432 RUNNING AT b9e7b8d7f3d3
= KILLED BY SIGNAL: 9 (Killed)
bash ./run_benchmark.sh -m chatglm3-6b -d nf4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d int4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_nf4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_int4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d w8a8_nf4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d w8a8_int4 -s 1 -bs 1 -in 256 -out 256 -i 1
bash ./run_benchmark.sh -m chatglm3-6b -d bf16 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d int8 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d nf4 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_fp16 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_w8a8 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_int8 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_int4 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_nf4 -s 2 -bs 1 -in 256 -out 256 -i 1
执行上述命令会报错,报错信息如下:
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 0 PID 2425 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)
=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 1 PID 2426 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)
=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 2 PID 2427 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)
=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 3 PID 2428 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)
=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 4 PID 2429 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)
=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 7 PID 2432 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)