-
- https://arxiv.org/pdf/1706.03762.pdf
- **Transformer**
- Seq2Seq Model
## Concept
### Structure
- Multi-head self-attention
- Scaled Dot-Product Attention
- Residual connection
- L…
-
Update on 2019/2/14, nearly one year later:
The implementation in this repo is definitely bugged. Please refer to my implementation [in a reply below](https://github.com/philipperemy/keras-attentio…
-
# 🚀 Feature request
As we're called `transformers`, it would be nice if there's a `Transformer` class that is not associated with any pretrained model and that we can directly instantiate, like
`…
-
## Environment info
- `transformers` version: 4.1.1
- Platform: Google Colab
- Python version: 3.7
- PyTorch version (GPU?): 1.8.1
- Tensorflow version (GPU?):
- Using GPU in script?: Yes
-…
lacls updated
3 years ago
-
## Environment info
- `transformers` version: 4.1.1
- Platform: Linux-4.15.0-99-generic-x86_64-with-glibc2.27
- Python version: 3.8.0
- PyTorch version (GPU?): 1.7.1 (True)
- Tensorflow …
-
# 在ai studio中运行如下代码：
```
!python ERNIE/demo/seq2seq/finetune_seq2seq_dygraph.py \
--from_pretrained ernie-1.0 \
--data_dir work/datasets/medical \
--max_steps 128 \
--save_dir work/save
```
…
-
## Environment info
- `transformers` version: 4.4.0.dev0
- blenderbot, bart, marian, pegasus, encoderdecoder, t5: @patrickvonplaten, @patil-suraj
```
python examples/seq2seq/run_seq2seq.py …
-
## Environment info
- `transformers` version: 3.5.1
- Platform: Linux-4.14.193-113.317.amzn1.x86_64-x86_64-with-glibc2.10
- Python version: 3.7.6
- PyTorch version (GPU?): 1.7.0 (True)
-…
-
**System information**
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Google Colaboratory
- TensorFlow version and how it was installed (source or binary): 2.4.1
- TensorFlow-Addons ver…
-
Please make sure that this is a bug. As per our
[GitHub Policy](https://github.com/tensorflow/tensorflow/blob/master/ISSUES.md),
we only address code/doc bugs, performance issues, feature requests a…