search

microsoft / mup

maximal update parametrization (µP)
https://arxiv.org/abs/2203.03466
MIT License
1.25k stars 90 forks source link

Torchdistx #15

Closed edwardjhu closed 1 year ago

edwardjhu commented 2 years ago

Add instructions to use torchdistx to avoid instantiating base and delta models.

ghost commented 2 years ago

CLA assistant check
Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.

:x: edwardjhu sign now
You have signed the CLA already but the status is still pending? Let us recheck it.

edwardjhu commented 1 year ago

@microsoft-github-policy-service agree