-
Hi,
Thanks for the nice work.
I downloaded a pre-trained Chinese RoBerta model. The model is pre-trained BERT like, containing 3 files, namely "config.json", "pytorch_model.bin" and "vocab.txt"
…
-
请问可以简单介绍一下RBT3、RBTL3吗？ 例如它的蒸馏细节。期待回复。
-
请问一下，我想无监督训练一些unlabeled的中文数据，请问有相关教程吗？我看了官网的，感觉官网的讲的不是很清楚。想请教一下
-
```
python -m torch.distributed.launch --nproc_per_node=8 run_squad.py \
--model_type bert \
--model_name_or_path bert-base-cased \
--do_train \
--do_eval \
--do_lower_case \…
-
Are the trained models used to parse the results submitted to the CoNLL 2019 shared task available for download?
-
## ❓ Questions & Help
Hi~
```
bert_path = 'D:/pretrain/pytorch/albert_base/'
tokenizer = BertTokenizer.from_pretrained(bert_path)
BERT = BertModel.from_pretrained(bert_path)
...
with torch.no_g…
-
## 🚀 Feature
in run_lm_finetuning.py
present how to finetune language model with dataset
## Motivation
But there isn't option to finetune whole word masking bert models
I suggest to add it
-
我想知道是恰好相同还是本来就是同一个
-
Why I couldn't use bert-serving-start load the model RoBERTa-wwm-ext-large? Sometimes Python stops running
-
## 🐛 Bug
When running run_squad.py as provided in the README once training is complete the prediction/evaluation component of the script crashes.
No prediction files are written are written.
…