issues
search
bigscience-workshop
/
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Other
1.31k
stars
213
forks
source link
Add bias a weight we need to sync as well across TP
#307
Closed
thomasw21
closed
2 years ago