search

microsoft / mup

maximal update parametrization (µP)
https://arxiv.org/abs/2203.03466
MIT License
1.37k stars 94 forks source link

dim_feedforward #61

Closed dreavjr closed 11 months ago

dreavjr commented 11 months ago

Sorry, my fat fingers clicked on the wrong field on this one. (-: