-
In this code snippet of file lxrt.modelling.py https://github.com/airsplay/lxmert/blob/9b8f0ffd56dba5490f37af9c14f3c112cc10358c/src/lxrt/modeling.py#L940-L953
masked_lm_loss is still being optimized…
-
## ❓ Questions and Help
Hi,
I have been facing this issue for quite a while now. It when I run the training command for visual_bert pre-trained on coco dataset for the hateful memes challenge.
##…
-
### Description
Using the $ pip install astropy in my windows running machine, below error was generated. Appreciate very much for the given the solution for the issue
### Expecte…
-
https://github.com/huggingface/transformers/blob/master/examples/run_language_modeling.py
in 225 row
When i use `tape-train transformer masked_language_modeling --batch_size 16 --learning_r…
-
**Describe the bug**
Output files have unequal spacing and inconsistent geotransform information.
**To Reproduce**
Steps to reproduce the behavior:
1. Download
`wget https://aria-share.jpl.nas…
-
A scientific research code often begins with a domain scientist, interested in solving a science question, developing a code and single-handedly serving the roles of user, developer, reviewer, and mai…
-
First I would like to say I'm very excited about this, as it's something I've been looking for a while now. I really appreciate how thoroughly you explained every step through your notebooks.
I've …
-
## 🐛 Bug
Model I am using: BERT
Language I am using the model on (English, Chinese....): English
```
from transformers import BertTokenizer, BertModel
tokenizer2 = BertTokenizer.from_pret…