-
I just tried to train an EncoderDeoder model for **summarization** task based on pre-trained *[BanglaBERT](https://huggingface.co/csebuetnlp/banglabert)*, which is an **ELECTRA** discriminator model p…
-
This [notebook](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/Leveraging_Pre_trained_Checkpoints_for_Encoder_Decoder_Models.ipynb#scrollTo=3FO5ESocXvlK) ([github link…
-
The workaround of the summarization task using **BERT2BERT** model showing that it's being experimented with CNN Daily-Mail dataset but when I try to execute that cell, it just says `[Errno 20] Not a …
-
Hi,
I hope first of all to open this problem in the right place (I hesitated to post in this repo but it seems less active with only issues in 1 year: https://github.com/huggingface/model_card).
…
-
**Describe the bug**
Converting a Bert2Bert model from [TensorFlow model official](https://github.com/tensorflow/models/blob/master/official/nlp/nhnet/models.py), I get the exact same error either us…
-
## ❓ Questions & Help
I'm currently trying to use a pretrained BertModel for finetuning but I want to remove some of the layers from the model before fine-tuning.
How do I do this?
-
## Environment info
- `transformers` version: 4.17.0.dev0
- Platform: Linux-5.13.0-1015-gcp-x86_64-with-glibc2.31
- Python version: 3.9.7
- PyTorch version (GPU?): 1.10.2+cu102 (False)
- Tensor…
-
## Environment info
- `transformers` version: 4.15.0
- Platform: Linux-4.15.0-162-generic-x86_64-with-debian-buster-sid
- Python version: 3.7.11
- PyTorch version (GPU?): 1.7.1 (True)
- Tensorflo…
-
**Describe the bug**
Converting a Bert2Bert model from [TensorFlow model official](https://github.com/tensorflow/models/blob/master/official/nlp/nhnet/models.py), I get the following errors at servin…
-
Hi, I have a question.
From the example code of [EncoderDecoderModel](https://huggingface.co/transformers/model_doc/encoderdecoder.html#transformers.EncoderDecoderModel.forward), pre-trained model …