sony / nnabla

Neural Network Libraries
https://nnabla.org/
Apache License 2.0
2.73k stars 334 forks source link

Options to scale gradients and to keep dtype in allreduce callback #1150

Closed TakuyaNarihira closed 1 year ago

TakuyaNarihira commented 1 year ago

Add scale_grad and keep_dtype option to allreduce callback to perform it for narrowed arrays.