-
I cannot reach the reported performance by running the RAG-Token model on the WOW dataset, especially for knowledge F1. I can only achieve KG F1 around 21-22, but the reported is 26-27. Could you give…
-
## Environment info
- `transformers` version: 4.4.2
- Platform: Darwin-20.3.0-x86_64-i386-64bit
- Python version: 3.7.4
- PyTorch version (GPU?): 1.3.1 (False)
- Tensorflow version (GPU?): no…
-
## Environment info
- `transformers` version: 4.8.1
- Platform: Ubuntu 20.04.2 LTS
- Python version: 3.7.10
- PyTorch version: 1.7.1
- Using GPU in script?: Yes
### Who can help
@patrick…
-
I trying to further fine-tune the given BB2_3B model on MSC + WOI datasets. I'm expect that the PPL scores on validation set won't change much after the fine-tuning. Surprisingly, I got a big PPL impr…
-
## Environment info
- `transformers` version: 4.13.0
- Platform: Linux-5.4.109+-x86_64-with-glibc2.10
- Python version: 3.8.8
- PyTorch version (GPU?): 1.10.0+cu113 (True)
- Tensorflow versio…
-
I was trying to reproduce ppl metric given [here](https://github.com/facebookresearch/ParlAI/blob/main/parlai/zoo/blenderbot2/model_card.md#metrics-used-and-evaluation-results) for blenderbot2.0 but c…
-
## Environment info
- `transformers` version: 4.1.1
- Platform: Linux-3.10.0-693.5.2.el7.x86_64-x86_64-with-centos-7.4.1708-Core
- Python version: 3.7.9
- PyTorch version (GPU?): 1.7.1 (False)…
-
using instructions at:
[https://github.com/clip-italian/clip-italian/tree/master/hybrid_clip]( https://github.com/clip-italian/clip-italian/tree/master/hybrid_clip)
[https://github.com/clip-italian/…
-
as it, no run_finetune_rag.sh.
i've done all the above in README.md, as that:
export HF_HOME and CHECKPOINTS. (many files have been downloaded to cache and ckpt dir and it seems work.)
cd scripts
…
-
## Environment info
- `transformers` version: 4.12.0
- Platform: Linux-5.4.0-88-generic-x86_64-with-debian-buster-sid
- Python version: 3.7.10
- PyTorch version (GPU?): 1.6.0 (True)
- Tensorflow …