Open ch3njust1n opened 6 years ago
Refer to page 5 of Large Scale Distributed Deep Networks
Also refer to Revisiting Small Batch Training for Deep Neural Networks
For poc, not necessary
Refer to page 5 of Large Scale Distributed Deep Networks