Open killawhale2 opened 1 year ago
I've read the supplement describing the details of the recurrent positional encoding (RPE).
However, I cannot seem to find the code which RPE is implemented and used.
Would the authors kindly point out where the implementation of RPE is in the released codebase?
@killawhale2 Please find the code of RPE in line 215 to 221 of model/transformer_v2.py
I've read the supplement describing the details of the recurrent positional encoding (RPE).
However, I cannot seem to find the code which RPE is implemented and used.
Would the authors kindly point out where the implementation of RPE is in the released codebase?