search

snowkylin / ntm

TensorFlow implementation of Neural Turing Machines (NTM), with its application on one-shot learning (MANN)
GNU Lesser General Public License v3.0
183 stars 65 forks source link

Converging of the network for different data sets? #12

Open shamanez opened 6 years ago

shamanez commented 6 years ago

I tried to train this network to identify 13 classes with 5 RGB images for each class. One image is like this.

20171221_175923

I modified the network to work with RGB. But even after 100000 iterations cannot see any kind of convergence.

Do you think this network is not capable of remembering information in above-mentioned images? Because in character data set the information is not complex as much as in above type images.

snowkylin commented 6 years ago

I am not very sure about this, but generally NTM is harder to converge compared with other DL models, which is a main drawback of this model.

albertchristianto commented 6 years ago

Hi @snowkylin, I also faced some problem with RGB images. Have you tried MANN implementation for RGB images. I have tried your code and this MANN code (https://github.com/hmishra2250/NTM-One-Shot-TF) for RGB images. hmishra2250's code converged but it takes a long time. On the other hand, your code even can't converged. I am just curious what is the different between your code and hmishra2250's code? I have tried to compare your code and hmishra2250's code. But, because I am still new on this topic, I haven't (maybe couldn't) found any useful information. Thanks in advanced. Best regards, Albert

snowkylin commented 6 years ago

@albertchristianto No, I haven't tried RGB images. Maybe you can try to convert images into gray scale and see if there is any change on the performance of the model. Sorry that I am busy these days and cannot afford much time to analyse other codes.

shamanez commented 6 years ago

@albertchristianto what about the accuracy? It is working or just converging?

albertchristianto commented 6 years ago

@snowkylin I extracted the feature using VGG16 then use it as my MANN input. it's okay. Thank you for your quick response. @shamanez for the hmishra2250's code converged (also the accuracy) but it takes a long time, also hmishra2250's code didn't have very clear explanation about what happen in the training process, therefore i am kind of doubting the result. I have a hard time to modify the parameter from hmishra2250's code.

shamanez commented 6 years ago

@albertchristianto check whether he used something like weight clipping or gradient norm. Because for me this cord is error free algorithmic wise.