issues
search
xrsrke
/
pipegoose
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
MIT License
76
stars
17
forks
source link
FP8 linear
#54
Open
3outeille
opened
9 months ago
3outeille
commented
9 months ago
Goal: Porting MSAMP FP8Linear layer to pipegoose
Goal: Porting MSAMP FP8Linear layer to pipegoose