search

microsoft / mup

maximal update parametrization (µP)
https://arxiv.org/abs/2203.03466
MIT License
1.37k stars 94 forks source link

Examples with ConvNets #10

Closed Aboussejra closed 2 years ago

Aboussejra commented 2 years ago

Could this be applied with Convnets ? I would really love to have an example with Convnets to understand better how to use the library for my company's use cases.

thegregyang commented 2 years ago

Hi,

The resnet example is also a convnet example. Let us know if that works for you.

thegregyang commented 2 years ago

Feel free to open this back up if the example doesn't work for you.