-
Hello,
It seems like some of the weights were renamed/shaped in the V2 model releases and I couldn't quite figure out how to map them to the old structure
```
# it seemed like
pos_q_proj => q…
-
Hi
Based on readme on [1], run_langauge_modeling.py does not support T5 model so far, it would be really nice to include this model as well.
There is also this line "data_args.block_size = tokenizer…
ghost updated
3 years ago
-
This seems like it would be really cool to use but unfortunately the example code in the readme is no longer valid, and I've been struggling for a long time to get this thing to work. It seems "NLITop…
-
On Colab, I did:
```
!pip install transformers
```
Then:
```
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("microsoft/deberta-xxlarge-v2")
…
-
Thanks for sharing the repo. However, I could not access the per-trained base and large models from the below paths.
https://github.com/microsoft/DeBERTa/releases/download/v0.1/base.zip
https://gi…
-
## Environment info
- `transformers` version:
- Platform: macos
- Python version: 3.8.3
- PyTorch version (GPU?): no
- Tensorflow version (GPU?): no
- Using GPU in script?: no
- Using dis…
-
## Environment info
- `transformers` version: 4.0.0
- Platform: Linux
- Python version: 3.8
- PyTorch version (GPU?): 1.7
### Who can help
@BigBird01 @LysandreJik
## Information
I'd l…
-
Hello,
Looks like bpe_encoder.bin is missing in https://huggingface.co/microsoft/deberta-xxlarge-v2/tree/main
Can you please upload it?
Thanks
-
With DeBERTa 1.5B model, we suppass T5 11B mode
should be "surpass"
-
When I ran the example script run_mlm.py to fine tune the pretrained deberta model on a customized dataset, I got the following error. The same command worked for roberta-base.
The command:
python…