-
https://github.com/PyTorchLightning/pytorch-lightning/blob/8c07d8bf905e395bbd2142b5df7b185b8e936c41/pytorch_lightning/trainer/connectors/checkpoint_connector.py#L284
The reported error is:
` File…
-
微博内容精选
-
Not certain this is a bug yet, but I'm getting this rarely after awhile of training and am not finding an issue in my side. Input to loss function looks good (no nan's). I'm working with a fairly co…
-
Hi Max,
I have a brand new MBP M1 Pro (macOS 12.1), and I tried to install sjSDM today, but no luck. I am doing a clean installation on this Mac, so nothing has been brought over from my Intel Mac.…
-
Hello,
While translating your optimizer to Flax ([here](https://github.com/nestordemeure/flaxOptimizers)), I noticed that you are using a traditional weight decay were you add the weight decay to t…
-
-
preferably the modified version with weight decay from here https://github.com/lessw2020/Best-Deep-Learning-Optimizers ?
-
should cool new optimizers live in this package?
https://github.com/facebookresearch/madgrad
https://github.com/facebookresearch/madgrad/blob/master/madgrad/madgrad.py
-
For example, how to use (if possible) the [pytorch-optimizer](https://github.com/jettify/pytorch-optimizer) library?
-
Those are apparently the most promising optimizers, would be very useful to see how it compare to RAdam/madgrad!
Adabelief
https://github.com/lessw2020/Ranger-Deep-Learning-Optimizer/issues/44
…