ImportError: cannot import name 'gelu' from 'transformers.models.distilbert.modeling_distilbert'

taoshen58 / LexMAE

17 stars 2 forks source link

Open wulaoshi opened 1 year ago

wulaoshi commented 1 year ago

This is a great job, but I got an error when I ran, and I guess torch.nn.GELU() should be used here?

taoshen58 commented 1 year ago

Sorry for late reply. I suspect this is caused by difference in torch version?