search

apache / mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
https://mxnet.apache.org
Apache License 2.0
20.73k stars 6.81k forks source link

Trainer.set_learning_rate is broken when distributed kvstore is used #15919

Open eric-haibin-lin opened 4 years ago

eric-haibin-lin commented 4 years ago

https://github.com/apache/incubator-mxnet/blob/master/python/mxnet/gluon/trainer.py#L265-L275 When update_on_kvstore=True, Trainer.set_learning_rate does not modify the learning rate on the remote parameter server

mxnet-label-bot commented 4 years ago

Hey, this is the MXNet Label Bot. Thank you for submitting the issue! I will try and suggest some labels so that the appropriate MXNet community members can help resolve it. Here are my recommended labels: Bug