search

Tendo33 / oneflow-test

oneflow test
0 stars 0 forks source link

readme

bert_test_1n8g

NVIDIA_GeForce_RTX_3080_Ti | master@59b64db | rank_per_process @59b64db | naive@59b64db -- | -- | -- | -- LibAI_bert_large_pretrain_graph nl24_nah16_hs1024_FP16_actrue DP2_MP2_PP2_zerofalse_stage0_mbs32_gbs512_acc8_1n8g | building graph Done! Cost time: 19.14s. building plan Done! Cost time: 18.08s. node0 : 6029-6738MIB | building plan Done! Cost time: 17.91s. building graph Done! Cost time: 18.9 s. node0 : 6026-6728MIB | building plan Done! Cost time: 18.14s. building graph Done! Cost time: 18.99s. node0 : 6598-6728MIB

LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP2_MP2_PP2_zerofalse_stage0_mbs32_gbs512_acc8_1n8g,png

LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP2_MP2_PP2_zerofalse_stage0_mbs32_gbs512_acc8_1n8g_50_220,png

LibAI_bert_large_pretrain_graph_nl24_nah16_hs1024_FP16_actrue_DP2_MP2_PP2_zerofalse_stage0_mbs32_gbs512_acc8_1n8g_100_220,png