-
Thank you for VisionEncoderModel. It is really nice!!
I am currently trying to develop an Indonesian VisionEncoderModel. However, during the validation step, I am getting the following error. I am wo…
-
The k bias is always zero in code. Is there any reason for this? This is different from the normal implement.
https://github.com/microsoft/unilm/blob/421cffe163e474189c410ee06dad48dbfdcbc135/beit/m…
-
Hello Mike,
thanks for your wonderfull work on the version V2.01.
I have a problem with my 2 encoders, when i program them from the menu the buttons are recognised and accepted.
When i restart, the…
-
## Environment info
- `transformers` version: 4.15.0
- Platform: MacOS
- Python version: 3.8
- PyTorch version (GPU?): 1.10 CPU
- Tensorflow version (GPU?): N/A
- Using GPU in script?: No
-…
-
Hello,
I am playing with the models provided by BEiT. Thanks for the great work!
I notice that BEiT models are using relative positional embedding as well as a tunable gamma, which are not menti…
-
## Environment info
- `transformers` version: 4.11.1
- Platform: Linux-5.4.104+-x86_64-with-Ubuntu-18.04-bionic
- Python version: 3.7.12
- PyTorch version (GPU?): 1.9.0+cu102 (True)
- Tensorflo…
-
## Environment info
- `transformers` version: 4.15.0
- Platform: macOS-10.15.7-x86_64-i386-64bit
- Python version: 3.9.7
- PyTorch version (GPU?): 1.10.0 (False)
- Tensorflow version (GPU?): …
-
In "https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt2ft.py#L69"
So, why do you not use mmdet version fp16…
-
Hello, @donglixp @addf400
Thank you for your great work and open-source code on BEIT. I've found that your published pre-trained models and logs are based on the ImageNet22K. And you know, it's h…
-
I am using beit, I find that with the default setting, the beit uses abs_pos_emb in the pretraining stage, while in finetuning stage, it seems not to use any kind of pos_embed. Did I understand it …