-
Are the trained models used to parse the results submitted to the CoNLL 2019 shared task available for download?
-
## 🚀 Feature
in run_lm_finetuning.py
present how to finetune language model with dataset
## Motivation
But there isn't option to finetune whole word masking bert models
I suggest to add it
-
## ❓ Questions & Help
Hi~
```
bert_path = 'D:/pretrain/pytorch/albert_base/'
tokenizer = BertTokenizer.from_pretrained(bert_path)
BERT = BertModel.from_pretrained(bert_path)
...
with torch.no_g…
-
我想知道是恰好相同还是本来就是同一个
-
Why I couldn't use bert-serving-start load the model RoBERTa-wwm-ext-large? Sometimes Python stops running
-
你好,我用你的程序,跑出来,评分只有0.52。感觉差太远了。我只把epoch设成1,batch_size设成8.其它没变。
-
## 🐛 Bug
When running run_squad.py as provided in the README once training is complete the prediction/evaluation component of the script crashes.
No prediction files are written are written.
…
-
非常感谢您开源这个项目,在使用过程中遇到了一些问题想请教一下。
我在之前的项目都是通过 冻结BERT+lstm进行后续任务,所以huggingface/transformers中都是直接用
```
bert_path = 'D:/pretrain/pytorch/albert_base/'
tokenizer = BertTokenizer.from_pretrained(bert_pat…
-
使用的cmrc2018公开的训练数据,运行baselines/models_pytorch/mrc_pytorch/run_mrc_cmrc2018.sh,训练几步后出现loss变为nan。检查后似乎没发现数据错误,还可能是什么原因呢?
-
Hello, It's a nice work for developers.
I am using these pre-train-models to some tasks.
It works in the BERT-wwm-ext with Huggingface's pytorch-bert.
As you said,
```
文本不需要经过分词,wwm只影响预训练过…