Modalities / modalities

A framework for training multimodal foundation models.
MIT License
38 stars 3 forks source link

Fix Pre-LN for GPT2 Model #136

Closed flxst closed 1 month ago

flxst commented 1 month ago

This PR fixes the pre-LN by reverting the changes (accidentally?) introduced here

References: