-
I have two questions
firstly:I'm running train_allennlp_local.sh with a bug:
ModuleNotFoundError: No module named 'scibert'
YML@Spuer-HR:~/Jiaxin/scibert-master/scripts$ ./train_allennlp_lo…
-
http://fyubang.com/2019/07/08/distributed-training/
瓦砾由于最近bert-large用的比较多，踩了很多分布式训练的坑，加上在TensorFlow和PyTorch之间更换，算是熟悉了一下各类框架的分布式训练接口，由于集中在一起讲可能比较乱，笔者准备分三到四篇来讲一下深度学习的分布式训练。这一篇先讲一下“分布式训练的类型与算法”。 分布式训练…
-
This could be a good first issue to contribute towards this repo. Comment below if you want to help and I will get you started. There is a long list to migrate so the more hands we have working on thi…
-
As mentioned above.
-
Hi, I'm following the guide, and everything seems to work except when I'm creating a predictor object I get:
File "bert.py", line 63, in
do_lower_case=False)
File "/home/w3pt/.local/lib/…
-
### Bug description
When we train an XLNet model with `CLM` masking, the model prints out its own evaluation metrics (ndcg@k, recall@k, etc.) from `trainer.evaluate()` step. If we want to apply our o…
-
**Describe the bug**
Model I am using UniLM:
I use the following code to load the model.
```
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("micro…
-
Thanks for your work.
I found that there is no lr_layer_decay_rate for embedding layer, which is weird because embedding is actually below transformer layers.
-
Hello,
I'm getting another error in the next step in the process, do you have an idea why this might be? I tried to debug a little bit myself, but I wasn't easily able to find where the error was b…
-
## Environment info
- `transformers` version: `4.6.0.dev0`
- Platform: `CentOS Linux release 7.7.1908 (Core)`
- Python version: `3.8.5`
- PyTorch version: `1.8.1 + cuda 10.2`
- Tensorflow versi…