search

kimhc6028 / relational-networks

Pytorch implementation of "A simple neural network module for relational reasoning" (Relational Networks)
https://arxiv.org/pdf/1706.01427.pdf
BSD 3-Clause "New" or "Revised" License
811 stars 162 forks source link

Encoding the question. #14

Closed AashishV closed 7 years ago

AashishV commented 7 years ago

In the model, there is no inclusion of an LSTM. How is the question then encoded? @gngdb Do you have any idea about this?

gngdb commented 7 years ago

The toy problem of sort_of_clevr provides the question as a binary vector to start with, see https://github.com/kimhc6028/relational-networks/blob/master/sort_of_clevr_generator.py#L98-L101

The work in the paper on the full clevr dataset hasn't been replicated here, and that would require an LSTM or something similar for the question embedding.

AashishV commented 7 years ago

Thank you for the clarification.