Is there any "adamw" style wrap_schedulefree?

facebookresearch / schedule_free

Schedule-Free Optimization in PyTorch

Apache License 2.0

1.91k stars 65 forks source link

Open And233 opened 1 week ago

And233 commented 1 week ago

Since these two wrap codes use momentum instead of betas and weights_decay, shall I get a version to combine with AdamW-like optimizer?