Open oym1994 opened 1 year ago
I have the same question.
I was wondering how actions are specifically input into the model since the paper lacks that detail and I was looking into this repository.
And what is b/260260205
and b/254902773
referring to?
Hi, thanks for your great job! I have read all the code and found that in the function transformer_network::_assemble_input_token_sequence, action_tokens are used to be a kind of input, but the values all are set to be zero(action_tokens = tf.zeros_like(action_tokens) ). My question is that why not use the data here? Have you done any experiment proving that it works bad? Thanks for your attention and keep waiting for your kind response!
` def _assemble_input_token_sequence(self, context_image_tokens, action_tokens, batch_size):
`