Closed yaox12 closed 3 weeks ago
Renaming transformer_engine_extensions
to transformer_engine_torch
makes me realize that we should avoid importing it outside of TE, so I expose these kernels to let MCore (or other framework) use them. cc @timmoon10
/te-ci pytorch
@timmoon10 Please re-run the CI.
/te-ci pytorch
Description
Expose
multi_tensor_*
kernels undertransformer_engine.pytorch.optimizers
to avoid importingtransformer_engine_torch
outside of TE.Type of change
Checklist: