Closed TevenLeScao closed 1 year ago
This ports a few changes I made in order to visualize the coord check plots when integrating mup into Megatron-Deepspeed:
@microsoft-github-policy-service agree
This ports a few changes I made in order to visualize the coord check plots when integrating mup into Megatron-Deepspeed: