search

codertimo / BERT-pytorch

Google AI 2018 BERT pytorch implementation
Apache License 2.0
6.11k stars 1.29k forks source link

Bidirectional Encoder = Transformer (self-attention), Is it true？ #26

Closed guotong1988 closed 5 years ago

guotong1988 commented 5 years ago

https://github.com/codertimo/BERT-pytorch/blob/alpha0.0.1a4/bert_pytorch/model/transformer.py#L9

Thank you！

wykdg commented 5 years ago

yes

codertimo commented 5 years ago

6 refer this issue