-
Optimizer plays a fundamental role in machine learning. This issue tracks the optimizers that people have requested for support in MXNet. We can also comment below to recommend new optimizers. It's in…
-
## Exploration
The element of a group giving the best results is marked in bold. If multiple elements are used together, all of them are marked. \
If a minor positive changes were noted in the early…
-
In both of the jupyter notebooks and the paper, I noticed that instead of using Adam, the most commonly used optimizer for transformers, you used Adagrad for all of the experiments. Is there a reason …
-
In a few different scenarios you'd want to have nested parameters, but sometimes a parameter isn't just a numerical/string value but instead a layer or object. An obvious example would be an optimizer…
-
When I run the demo of gdl_apps/EMOCA/demos/test_emoca_on_images.py, I get the following errors:
, but unfortunately I am meeting some package conflicts (resolving them creates other conflicts, an…
-
## 🚀 Feature
Easier change optimizer / learning rate without recoding
### Motivation
Usually when we want to change the optimizer from one to another(for example,using Adam to fast init trainin…
-
请问训练了上百万次，没改动数据源，Accuracy和Cost一直上下波动是什么原因？总是附近徘徊，训练了几天都是这样
 but seems like it is straightforward to implement. See […