LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP16_MP1_PP1_zerotrue_stage2_mbs8_gbs512_acc4_2n8g

[Tendo33]

case4

NVIDIA_GeForce_RTX_3080_Ti | master@b51cb72 | rank_per_process @021e5e62 | naive@021e5e62 -- | -- | -- | -- LibAI_bert_large_pretrain graph_nl24_nah16_hs1024_FP16_actrue DP16_MP1_PP1_zerotrue_stage2 _mbs32_gbs512_acc4_2n8g | building plan Done! Cost time: 24.16s. building graph Done! Cost time: 12.5s node0:4094MIB–4094MIB node1:3148MIB–3148MIB [[master_output.log](https://oneflow-test.oss-cn-beijing.aliyuncs.com/OneAutoTest/onebench/libai/sunjinfeng_bert_test/case4/b51cb72_master4/LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP16_MP1_PP1_zerotrue_stage2_mbs8_gbs512_acc4_2n8g/output.log)] | building plan Done! Cost time: 14.09s. building graph Done! Cost time: 14.6 s. node0: 4094MIB--4094MIB node1:3148MIB–3148MIB [[rank_per_process_output.log](https://oneflow-test.oss-cn-beijing.aliyuncs.com/OneAutoTest/onebench/libai/sunjinfeng_bert_test/case4/a442869_env_rank4/LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP16_MP1_PP1_zerotrue_stage2_mbs8_gbs512_acc4_2n8g/output.log)] | building plan Done! Cost time: 27s. building graph Done! Cost time: 14.91s. node0:4094MIB--4094MIB node1:3148MIB–3148MIB [[naive_output.log](https://oneflow-test.oss-cn-beijing.aliyuncs.com/OneAutoTest/onebench/libai/sunjinfeng_bert_test/case4/a442869_naive4/LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP16_MP1_PP1_zerotrue_stage2_mbs8_gbs512_acc4_2n8g/output.log)]

• 全局loss曲线对比

• 50步loss曲线对比

• 100步loss曲线对比