bigcode-project / Megatron-LM

Ongoing research training transformer models at scale
Other
371 stars 48 forks source link

Mqa+flash attn #46

Closed joaomonteirof closed 1 year ago