-
Hi,
I want to take a sentence-transformer model( say xlmr) and extend its context length using rope. How to do this? Can you provide a code for this ?
-
Hello,
When I run the code with the following commands:
`python scripts/probe.py --model xlmr_base --lang en --pred_dir $OUTPUT`
I met the following erro:
```
bug for pid P19
CUDA error:…
-
```bash
In [58] xlmr = torch.hub.load('pytorch/fairseq', 'xlmr.large')
In [59]: xlmr.model.encoder.lm_head
Out[59]:
RobertaLMHead(
(dense): Linear(in_features=1024, out_features=1024, bias=True…
-
One of the common cases in text is to define base model architecture and create bigger version just by increasing the number of parameters in terms of number of layers, hidden dimensions etc. Take XL…
-
```
ValueError: invalid literal for int() with base 10: '0a0'
```
Possibly related to https://github.com/facebookresearch/fairseq/issues/4532
```
This behavior is deprecated in Hydra 1.1 and will…
-
- L6xH768 MiniLMv2 distilled from RoBERTa-Large
- L12xH384 MiniLMv2 distilled from RoBERTa-Large
- L6xH384 MiniLMv2 distilled from RoBERTa-Large
- L12xH384 MiniLMv2 distilled from XLMR-Large
- L6x…
-
Hi,
Any idea why XLMR results on UDPOS are so bad for Japanese, Chinese and Yoruba?
Thanks
-
Hi @aconneau,
I can't download the 2 files you referenced in the issue #253
Could you fix this please ?
Thanks in advance
Philippe
-------
this one for the counts: https://dl.fbaipublicfiles.com…
-
**Bug**
- Got unexpected_keys error from `torch.nn.module.load_state_dict` function on key `lm.embeddings.position_ids`
**To replicate**
```
from pythainlp.tag.named_entity import NNER
nner…
-
OSError: Can't load weights for 'xlm-roberta-base'. Make sure that:
- 'xlm-roberta-base' is a correct model identifier listed on 'https://huggingface.co/models'
- or 'xlm-roberta-base' is the co…