mlcommons / GaNDLF

A generalizable application framework for segmentation, regression, and classification using PyTorch
https://gandlf.org
Apache License 2.0
165 stars 79 forks source link

[FEATURE] Add new optimizers #968

Closed sarthakpati closed 1 day ago

sarthakpati commented 1 week ago

Is your feature request related to a problem? Please describe.

A lot of work has been done with optimizers recently, and adding a few of them would be great.

Describe the solution you'd like

Add the following:

  1. https://github.com/lucidrains/lion-pytorch
  2. https://github.com/iShohei220/adopt

Describe alternatives you've considered

N.A.

Additional context

N.A.

scap3yvt commented 2 days ago

Please assign to me.

sarthakpati commented 2 days ago

Perfect, thank you.