[Optimizer] Move AdamW in GluonNLP to MXNet

dmlc / gluon-nlp

NLP made easy

https://nlp.gluon.ai/

Apache License 2.0

2.56k stars 538 forks source link

[Optimizer] Move AdamW in GluonNLP to MXNet #1426

Closed sxjscience closed 3 years ago

sxjscience commented 3 years ago

Description

Move the adamw optimizer defined here to MXNet. https://github.com/dmlc/gluon-nlp/blob/20321598a732d254d4a9e036eecbe0ae8abb48a0/src/gluonnlp/optimizer.py#L31-L32

leezu commented 3 years ago

It should be moved to https://github.com/apache/incubator-mxnet/tree/master/python/mxnet/optimizer

One needs to open a PR at MXNet to introduce the optimizer. Once that PR is merged and a day has passed for a new nightly build to become available, one can open a PR at GluonNLP to drop it here.