-
## 🐛 Bug
Model I am using TFALBERT:
Language I am using the model on (English, Chinese....): English
The problem arise when using:
* [ ] the official example scripts:
`from transform…
-
Hi,
The work is great! Is there any GLUE experiments result on Bert? I reproduced LST Bert in MRPC getting accuracy of 75%, is it normal? Thanks! :)
-
**Describe the bug**
A hyperparameter training.py ran well without deepspeed. However, when I tried `deepspeed --master_port XXXXX hyperparameter training.py --deepspeed --deepspeed_config ds_config…
-
## Environment info
- `transformers` version: 4.6.1
- Platform: MacOS 10.15.7
- Python version: 3.8
- PyTorch version (GPU?): 1.8.1 No GPU
- Tensorflow version (GPU?): No
- Using GPU in scri…
-
老师好!我用论文开源的参数在CMRC2018数据集上实验了一下,没能得到论文中的结果,想请教一下我的做法哪里存在问题,非常感谢!
以下是我的实践情况:
我是在CMRC2018数据集上用论文开源的bert参数做fine tuning的,使用的论文中推荐的学习率3e-5,batch size为7,模型网络结果与google开源的中文bert一致。优化器使用的是google开源的AdamWe…
-
I am trying to use TrOCR for recognizing Urdu text from image. For feature extractor, I am using DeiT and bert-base-multilingual-cased as decoder. I can't figure out what will be the requirements if I…
-
Hi, I am very interested in your paper, and have been using your code for training.
However, I have a question in the Bert model training part.
In your code, only parameters in first 10 layers of …
-
Hi , now i am trying to train SDXL with images of resolutin 768x768, i set batch size for 2 in env file so i have 16 images on folder.
I am using resolution type 'pixel' an resolution '768' both env …
-
- [x] QA On Squad v2
-
According to my understanding, the results of Table 1 and 2 in the paper are finetuned on ScanObjectNN and ModelNet40. The current version provides the codes of pretraining and zero-shot evaluation on…