www0wwwjs1 / Matrix-Capsules-EM-Tensorflow

A Tensorflow implementation of CapsNet based on paper Matrix Capsules with EM Routing
Apache License 2.0
218 stars 83 forks source link

IMPROVE stop backprop until last iter to speed up each iteration #13

Closed yhyu13 closed 6 years ago

yhyu13 commented 6 years ago

32 4 4 4, 5 iterations MNIST macintosh no stop gradient

screen shot 2017-12-07 at 12 08 25 am

32 4 4 4, 5 iterations MNIST macintosh stop gradient enabled

screen shot 2017-12-07 at 12 06 04 am

As fast as 2 iterations (iter_routing = 1) no stop gradient

screen shot 2017-12-07 at 12 20 20 am

10 iterations stop gradient enabled is as fast as 5 iterations no stop gradient

screen shot 2017-12-07 at 12 22 55 am