xyn1201
commented
2 years ago - 为发版添加几个数据并行、数据+流水并行的用例
- 添加t5用例、脚本和t5_nl24_nah16_hs2304的配置
- 为megatron中t5增加split_rank参数
- 完善extract_bert.py
Closed xyn1201 closed 2 years ago
xyn1201
commented
2 years ago