-
## Environment info
- `transformers` version: 4.0.0
- Platform: Linux-5.4.0-1030-aws-x86_64-with-debian-buster-sid
- Python version: 3.7.8
- PyTorch version (GPU?): 1.7.0 (True)
- Tensorflow vers…
-
First, thank you for great works!
1. Does that tie function work for sharing pretrained weight of encoder's embedding with weight of decoder's embedding?https://github.com/huggingface/transformers/…
-
Hi,
I've been following [this](https://colab.research.google.com/drive/1WIk2bxglElfZewOHboPFNj8H44_VAyKE?usp=sharing) to implement a bert2bert seq2seq model which works pretty well. Now I would lik…
md975 updated
3 years ago
-
## Environment info
- `transformers` version: 4.5.0
- Platform: Ubuntu 18.04.5 LTS
- Python version: 3.6.9
- PyTorch version (GPU?): 1.8.1 (Quadro GV100 )
- Tensorflow version (GPU?):
- Usi…
-
## Information
Model I am using Bert2Bert, training using Seq2SeqTrainer on Google Colab.
## Details
I am trying to use a Bert2Bert model on multiple-choice qa dataset using Seq2SeqTrain…
-
Hello,
I tried the example code in the official website as below.
# code
`from transformers import EncoderDecoderModel, BertTokenizer
import torch
tokenizer = BertTokenizer.from_pretrained('ber…
C7ABT updated
3 years ago
-
Hi,
I am trying to train a Bert2Bert model for text summarization. I followed the exact steps in [BERT2BERT for CNN/Dailymail](https://colab.research.google.com/drive/1Ekd5pUeCX7VOrMx94_czTkwNtLN32U…
segef updated
3 years ago
-
Here is what I ran:
```python
from transformers.hf_api import HfApi
from tqdm import tqdm
import pandas as pd
model_list = HfApi().model_list()
model_ids = [x.modelId for x in model_list]
…
-
At the moment when one loads a Bert2Bert:
```python
model = EncoderDecoderModel.from_encoder_decoder_pretrained("bert-base-cased", "bert-base-cased")
```
does not automatically set `use_cache`…
-
I want to train a long sequence dataset (MIDI text event representation like the one in [MuseNet](https://openai.com/blog/musenet/#dataset)) from scratch. Since, I can't split the sequence to "sentenc…