-
### 🚀 Feature
Hello all,
I would like to add Adabound to the list of existing optimizers in the torch.optim module.
Here is the link to the paper - https://openreview.net/pdf?id=Bkg3g2R9FX
…
-
url : https://www.kaggle.com/aminao4000/driver-distraction-adabound-optimizer
-
Thanks for a good optimizer
According to usage
optm = AdaBound(lr=1e-03,
final_lr=0.1,
gamma=1e-03,
weight_decay=0.,
amsbound=Fals…
-
https://github.com/wayne391/Image-Super-Resolution/blob/master/src/models/RCAN.py
Just change
`optimizer = torch.optim.Adam(model.parameters(), lr=1e-4, amsgrad=False)`
to
`optimizer = adabound.…
-
Thanks for implement AdaBound with mxnet, but have you test on cifar10 dataset ?
-
```
/home/xxxx/.local/lib/python3.7/site-packages/adabound/adabound.py:94: UserWarning: This overload of add_ is deprecated:
add_(Number alpha, Tensor other)
Consider using one of the follo…
-
File "/adabound.py", line 40, in __init__
self.lr = K.variable(lr, name='lr')
AttributeError: can't set attribute
-
I'm using dense_vnet for segment ct data. Its working fine. But , I need to customize optimization, loss function and activation function. I got error like no object takes no parameters for optimiz…
-
I tested three methods in a very simple problem, and got the result as above.
Code a…
-
Thank you very much for sharing this impressive work. I am somehow receiving the following error:
```
for group, base_lr in zip(self.param_groups, self.base_lrs):
AttributeError: 'AdaBound' o…