search

ronghanghu / snmn

Code release for Hu et al., Explainable Neural Computation via Stack Neural Module Networks. in ECCV, 2018
http://ronghanghu.com/snmn/
BSD 2-Clause "Simplified" License
72 stars 6 forks source link

What is the memory vector? #7

Open ggaemo opened 5 years ago

ggaemo commented 5 years ago

What is the memory vector? It is not mentioned in the paper. In Table 1. in the paper, there are no references to a memory vector. Also in the "mem_out" variable, it shows that c_i is also inside it, which is not as described in Table 1.

ronghanghu commented 5 years ago

Hi, the mem_out variable is only used in DescribeOne and DescribeTwo modules to output information encoding the answer (in other modules, the mem_out is zero, and in NoOp, it gets passed unchanged).

It is soft-averaged here and then used here to predict the answer.

ggaemo commented 5 years ago

Thank you for your response. In the ECCV paper, there is no element of memory vector. In Table 1., there is no recursive behavior. It seems that 'y' in Table 1. refers to the memory vector. Is it right?