facebookresearch / schedule_free

Schedule-Free Optimization in PyTorch
Apache License 2.0
1.83k stars 63 forks source link

Minimal harness for running CIFAR10 experiments #9

Open nelaturuharsha opened 5 months ago

nelaturuharsha commented 5 months ago

Hello! Just in case it might be useful for others who'd like to test the optimizer out as well on the CIFAR10 dataset -- just wanted to add my training harness.

Should be easy to swap out out with any other model, or something like CIFAR100 as well.

Its more or less in the same spirit as the MNIST example, and should be easily runnable :)

adefazio commented 5 months ago

Thanks! I will look over this Monday.

adefazio commented 5 months ago

Thanks for the contribution. We are going to decided on the exact ResNet-18 variant and default training parameters over the next few days.

nelaturuharsha commented 5 months ago

Sounds good :) Thanks for looking into it -- happy to modify if required!

tfaod commented 5 months ago

@nelaturuharsha I'm currently working on this, and will have this out soon