LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP4_MP2_PP2_zerofalse_stage0_mbs32_gbs512_acc4_2n8g

[Tendo33]

case2

NVIDIA_GeForce_RTX_3080_Ti | master@b51cb72 | rank_per_process @a442869 | naive@a442869 -- | -- | -- | -- LibAI_bert_large_pretrain_graph nl24_nah16_hs1024_FP16_actrue DP4_MP2_PP2_zerofalse_stage0_ mbs32_gbs512_acc4_2n8g | building graph Done! Cost time: 21.37s. building plan Done! Cost time: 20.65s. node0:6582MIB–6728MIB node1:5126MIB–5126MIB [[master_output.log](https://oneflow-test.oss-cn-beijing.aliyuncs.com/OneAutoTest/onebench/libai/sunjinfeng_bert_test/case2/b51cb72_master2/LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP4_MP2_PP2_zerofalse_stage0_mbs32_gbs512_acc4_2n8g/output.log)] | building plan Done! Cost time: 17.52s. building graph Done! Cost time: 22.84 s. node0:6576MIB--6722MIB node1:5126MIB–5126MIB [[rank_per_process_output.log](https://oneflow-test.oss-cn-beijing.aliyuncs.com/OneAutoTest/onebench/libai/sunjinfeng_bert_test/case2/a442869_env_rank2/LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP4_MP2_PP2_zerofalse_stage0_mbs32_gbs512_acc4_2n8g/output.log)] | building plan Done! Cost time: 21.07s. building graph Done! Cost time: 23.82s. node0:6576MIB--6722MIB node1:5126MIB–5126MIB[[naive_output.log](https://oneflow-test.oss-cn-beijing.aliyuncs.com/OneAutoTest/onebench/libai/sunjinfeng_bert_test/case2/a442869_naive2/LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP4_MP2_PP2_zerofalse_stage0_mbs32_gbs512_acc4_2n8g/output.log)]

---

• 全局loss曲线对比

• 50步loss曲线对比

• 100步loss曲线对比