search

facebookresearch / SpanBERT

Code for using and evaluating SpanBERT.
Other
881 stars 175 forks source link

continue pretraining #79

Closed houliangxue closed 2 years ago

houliangxue commented 2 years ago

Hi，when I tried load your pretrained model(SpanBERT base & cased) and continue pretraining，I got the erro Exception:“Cannot load model parameters from checkpoint, please ensure that the architectures match” so，how can I load your （SpanBERT base & cased）correctly，please

phosseini commented 2 years ago

@houliangxue I wonder if you could run the continued pretraining successfully? If yes, can you let me know how you loaded the pretrained model? I have the model.pt which is the pretrained checkpoint, but not sure how to properly load it before running the train.py for continued pretraining.