mosaicml / examples

Fast and flexible reference benchmarks
Apache License 2.0
441 stars 125 forks source link

TransformerEngine support in MosaicGPT #303

Closed dskhudia closed 1 year ago

dskhudia commented 1 year ago

[WIP] Not-ready-for-review Add support for TransformerEngine Layers.

dakinggg commented 1 year ago

Closing because llm has moved to llm-foundry.