Closed zhaowenlovehome closed 4 years ago
relu
can be moved behind the concat
.
sorry,I just find out that the source code of paper is the same as you
sorry, so it is more accurate to move it behind the concat?
@lmomoy I think behind or before is equivalent.
cheap_opt is liner in paper, why relu?