search

www0wwwjs1 / Matrix-Capsules-EM-Tensorflow

A Tensorflow implementation of CapsNet based on paper Matrix Capsules with EM Routing
Apache License 2.0
218 stars 83 forks source link

NORB dataset download & convert to TFRecord & Integrate with this repo #3

Closed yhyu13 closed 6 years ago

yhyu13 commented 6 years ago

HI @www0wwwjs1

My name is Yohan. I am also developing a Matrix-Capsule repo. I've done the NORB preprocessing but not yet on physical implementation. I am glad to see you've already got results. This pull request contains my work on NORB dataset download & convert to TFRecord and read training&test data just like you do in util.py. These method work on my machine but you still want to create a branch a test it.

yhyu13 commented 6 years ago

It would be great if you have time to checkout my repo: https://github.com/yhyu13/Matrix-CapsNet-EM-routing-tensorflow as well XD

yhyu13 commented 6 years ago

Hi, @www0wwwjs1

I've difficulty in understanding coord_addhere. So I couldn't train a model properly. May be you can explain it a bit?

www0wwwjs1 commented 6 years ago

Hi Yohan，thank you very much for your work! now we can report some results on smallNORB:). I'll check the code and merge them asap. For the coord_add, they are constants in the so called Coordinate Addition technique in the paper. Since the output of ConvCaps2 has 3*3 positions, I manually calculate the center coordinates of the receptive field of each position on original input image and use them as constant parameters. So the coord_add in my code is specific for MNIST dataset. Hopefully this can help.

Btw, are you sure that the em routing work is also from Hinton's group, since the paper is still under review. I asked some people and no one knew the exact information about authors. My weixin is zhang576266, if you are interested we can have more discussions about the experiments and the code.