search

dhlee347 / pytorchic-bert

Pytorch Implementation of Google BERT
Apache License 2.0
589 stars 181 forks source link

Is GEGLU innovative, or is it derived from a certain paper? #33

Closed takfate closed 3 years ago

takfate commented 3 years ago

Is GEGLU innovative, or is it derived from a certain paper?