Mukosame / Zooming-Slow-Mo-CVPR-2020

Fast and Accurate One-Stage Space-Time Video Super-Resolution (accepted in CVPR 2020)
GNU General Public License v3.0
908 stars 165 forks source link

Shared cells for bidirectional lstm #57

Closed NateLol closed 3 years ago

NateLol commented 3 years ago

Hi there,

I am curious about your choice of using the same cell for bidirectional lstm here as they are usually learned in a separate way.

Thanks, Nate

Mukosame commented 3 years ago

Hi @NateLol , thanks for asking it! This loc is left because we actually tried using different cells before. There used to be a 'self.backward_net' in this line. It doesn't appear in the final version for two reasons:

  1. less parameters;
  2. no obvious performance improvement; 2.5 we use temporal augmentation (that is, randomly revert the sequence during the training). I guess that's part of the reason why reason 2 happens.

Please let me know if you have more questions :)

NateLol commented 3 years ago

Well explained thanks!!