search

huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
https://huggingface.co/transformers
Apache License 2.0
134.73k stars 26.94k forks source link

wwm-bert lm_finetune #1352

Closed yangDDDD closed 4 years ago

yangDDDD commented 5 years ago

🚀 Feature

in run_lm_finetuning.py present how to finetune language model with dataset

Motivation

But there isn't option to finetune whole word masking bert models I suggest to add it

stale[bot] commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.