Open BIGJUN777 opened 2 years ago
Hi, there. In the paper, you described rescaling residual connections, while I did not find this in the current code. Did I miss something?
I did not find either. Actually, this paper is quite difficult to read as the authors are not intend to let you understand some operation at first.
Hi, there. In the paper, you described rescaling residual connections, while I did not find this in the current code. Did I miss something?