NVIDIA / TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

https://docs.nvidia.com/deeplearning/transformer-engine/user-guide/index.html

Apache License 2.0

1.61k stars 256 forks source link

remove code duplication in a test #915

Closed rybakov closed 3 weeks ago

rybakov commented 3 weeks ago

Description

Deduplicated class FP8GemmModule in a unit test.

Type of change

Code refactor

timmoon10 commented 3 weeks ago

/te-ci pytorch