facebookresearch / schedule_free

Schedule-Free Optimization in PyTorch
Apache License 2.0
1.91k stars 65 forks source link

DeepSpeed support? #3

Closed catid closed 7 months ago

catid commented 7 months ago

I don't see a way to call optimizer.eval() as described by the README. Is this compatible with DeepSpeed training?

catid commented 7 months ago

Hm nevermind I think I misunderstood

michaelfeil commented 4 months ago

@catid does it have support?