GELU is available in PyTorch

codertimo / BERT-pytorch

Google AI 2018 BERT pytorch implementation

Apache License 2.0

6.09k stars 1.29k forks source link

Open hubin-keio opened 1 year ago

hubin-keio commented 1 year ago

the GELU class is available in PyTorch (https://pytorch.org/docs/stable/generated/torch.nn.GELU.html). No need to implement it in utils/GELU.py

ShaohanTian commented 1 year ago

Nice