Closed talkhanz closed 10 months ago
i guess ill provide a bit more clarity on position_embedding='learned'. @pascalnotin suggested to keep this as our default positional encoding scheme. it's also in the config yaml files.
i guess ill provide a bit more clarity on position_embedding='learned'. @pascalnotin suggested to keep this as our default positional encoding scheme. it's also in the config yaml files.