Closed VimalMollyn closed 1 year ago
Do you apply any positional encoding to the input before feeding it to the transformer encoder?
Hi, we do not apply any positional encoding because a performance drop can be observed by doing that.
Do you apply any positional encoding to the input before feeding it to the transformer encoder?