huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
https://huggingface.co/transformers
Apache License 2.0
135k stars 27.01k forks source link

Model trained on Wikipedia Articles #2489

Closed ElToro13 closed 4 years ago

ElToro13 commented 4 years ago

Is there any Model trained on Wikipedia Articles?

BramVanroy commented 4 years ago

IIRC BERT was trained on BookCorpus and Wikipedia

stale[bot] commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.