Closed denera closed 3 weeks ago
This PR fixes misplaced asserts on a module attribute that only exists for TE modules, but is incorrectly applied to non-TE modules.
Supersedes #913.
primary_weights_in_fp8
LGTM
Description
This PR fixes misplaced asserts on a module attribute that only exists for TE modules, but is incorrectly applied to non-TE modules.
Supersedes #913.
Type of change
Changes
primary_weights_in_fp8
attribute.Checklist: