-
## Environment info
- `adapter-transformers` version: 3.2.1
- Platform: Linux-6.2.0-27-generic-x86_64-with-glibc2.37
- Python version: 3.10.9
- PyTorch version (GPU?): 1.13.1 (GPU)
## …
-
# 🚀 Feature request
Hi,
I am trying to add the option of using GPT2 as the decoder in the EncoderDecoder model, which only support
## Motivation
For a generation problem, it usually better…
-
Hello,
thanks for sharing the code!
I met two problems when using the code:
(1) when I try to initialize the tokenizer, there is a line `tokenizer.bos_token_id = tokenizer.cls_token_id`
I …
-
I'm trying to do summarization in Spanish and the only model I found is: https://huggingface.co/mrm8488/bert2bert_shared-spanish-finetuned-muchocine-review-summarization
But when I do:
```
from t…
-
I observed that [this function](https://github.com/huggingface/trl/blob/1e68753216105a4aca733b32f7c4b50ff1fedfca/trl/models/modeling_value_head.py#L299C1-L304C21) checks for the existence of the `lm_h…
-
### System Info
I am trying to run an encoder-decoder kind of seq2seq model using TGI
I read the docs in here
https://huggingface.co/docs/transformers/model_doc/bert-generation
however it seem…
-
# ❓ Questions & Help
## Details
Hey, I want to use EncoderDecoderModel for parallel trainging. When I save my model, I got the following questions. How can I fix this ?
'DistributedDataPa…
AI678 updated
4 months ago
-
### System Info
```
- `transformers` version: 4.31.0
- Platform: Linux-4.15.0-192-generic-x86_64-with-glibc2.27
- Python version: 3.11.4
- Huggingface_hub version: 0.16.4
- Safetensors version: …
-
## 1. The entire URL of the file you are using
https://github.com/tensorflow/models/blob/master/official/nlp/nhnet/models.py
## 2. Describe the bug
While using a Bert2Bert model instance sett…
-
Hi all,
I've trained an `EncoderDecoder` model but I cannot load it via `AutoModelForSeq2SeqLMWithValueHead.from_pretrained`.
My `EncoderDecoder` model has been defined by tying together two RoBER…