search

hpi-xnor / BMXNet

(New version is out: https://github.com/hpi-xnor/BMXNet-v2) BMXNet: An Open-Source Binary Neural Network Implementation Based on MXNet
Apache License 2.0
349 stars 95 forks source link

Low-bit width gradients #32

Closed analog-cbarber closed 5 years ago

analog-cbarber commented 6 years ago

Is there any plan to implement the stochastic quantization for gradients as described in the DoReFa-Net paper?

yanghaojin commented 6 years ago

We are currently focusing on how to further improve the accuracy. This may be more interesting for the community. Quantization of gradients is also useful, but we don't have enough manpower to do this for now, should be a future work.