search

FlagOpen / FlagScale

FlagScale is a large model toolkit based on open-sourced projects.
Other
167 stars 42 forks source link

Mixtral iluvatar modified #148

Closed commanderhanke closed 4 months ago

commanderhanke commented 5 months ago

modified the transformer_engine custom layer to adapt for the iluvatar SDK(try except for fp8)