-
An error occurred while run in class DisentangledSelfAttention.forward() where query_states.size(1) > hidden_states.size(1):
https://github.com/microsoft/DeBERTa/blob/master/DeBERTa/deberta/disen…
lgstd updated
3 years ago
-
https://huggingface.co/IDEA-CCNL/Erlangshen-DeBERTa-v2-97M-CWS-Chinese/discussions/1
use_fast为False也不行
```
OSError: Can't load tokenizer for '/data/pretrained_models/Erlangshen-DeBERTa-v2-97M-CWS…
-
i am trying to quantize deberta-base and save the quantized model, so i do as follows
```
from transformers import AutoModel, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("microsoft/…
-
# Description
OpenAssistant has released on HF the reward models they trained on the open-source datasets. Even if they are not tailored for the user need, we could lavarege them as a starting poin…
-
## 0. 論文
| タイトル | DeBERTa: Decoding-enhanced BERT with Disentangled Attention |
|:-------|:--|
| リンク | https://arxiv.org/abs/2006.03654 , https://github.com/microsoft/DeBERTa |
| 著者 | Pengc…
-
Paper in case you missed it.
https://arxiv.org/abs/2006.03654
-
It seems Microsoft has been able to push the performance on STS-b to 92.5: https://github.com/microsoft/DeBERTa
Their models are available via huggingface, but I'm not sure if their STS fine-tuned …
-
https://yam.gift/2020/06/27/Paper/2020-06-27-DeBERTa/
Yam | AI | NLP | 人工智能 | 哲学 | 自然语言处理 | 机器学习
-
1. Additional metrics to test
* [high priority] BERTScore-sentence, MNLI, {RoBERTa, DeBERTA}, Entail - Contradict, top-k and top-p
* [medium] BERTScore-original, DeBERTa -- to see how much…
-
I am thinking about creating DeBERTa version of this project. Initially I thought to use it as a backbone, because it's easier to modify than llama.cpp, but performance is really important for my case…