The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data.

google-research / albert

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Apache License 2.0

3.23k stars 571 forks source link

Open guotong1988 opened 3 years ago

guotong1988 commented 3 years ago

Any one know where to get them? Thank you and thank you.