-
### 🚀 The feature, motivation and pitch
Like MultiheadAttention which was proposed in **`Transformer`** paper similarly, can we have Additive attention
proposed in `**Neural Machine Translation by …
-
Read the papers in [Deep Learning’s Most Important Ideas](https://www.kdnuggets.com/2020/09/deep-learnings-most-important-ideas.html).
- [x] Tackling ImageNet with AlexNet and Dropout
- [x] [I…
-
## 一言でいうと
Tokenを順次生成していく自己回帰型の翻訳ではなく、潜在表現から同時にサンプリングして文生成を行う研究。精度は犠牲になるが(BLEU -2.0)、圧倒的に高速(7.8~12.5倍)というメリットがある。Transformerベースのモデルで潜在表現を作成するが、生成文長も予測し生成を行っている。
![image](https://user-images.githu…
-
I know, Apertium is a generation behind the fancy deep learning translation engines, but, afaik, it's the best we have right now in a usable way at the libre world.
There are open source engines fo…
-
https://github.com/ufal/neuralmonkey
An open-source tool for sequence learning in NLP built on TensorFlow.
Neural Sequence Learning Using TensorFlow
The Neural Monkey package provides a highe…
-
请问论文Universal Conditional Masked Language Pre-training for Neural Machine Translation中所描述的数据集size是指什么,以及能否提供论文中所使用的数据下载源。
![image](https://user-images.githubusercontent.com/60919370/204527286-044f6cd…
-
**Describe the bug**
Both of the queries provided below will throw StopIteration errors even when the http requests are successful.
**To Reproduce**
```
import logging
import sys
# Configure…
-
## 简介
由sentence-level的平行语料扩展到document-level的平行语料方法(所谓document-level实际是4个连续的句子,因为评价BLEU的时候是4个句子连在一起评,参照#6)。实验了几种:
* `random`: 随便选3个bitext凑成一个fake context的平行数据。可能导致让模型忽略context
* `copy`: 对输入句子copy一份,…
-
### Sources
- https://github.com/ZechengLi19/Awesome-Sign-Language
- https://github.com/Skye601/SLR
- https://www.sign-lang.uni-hamburg.de/lrec/project/asllrp.html
- https://www.semanticscholar.…
-
[1] Sequence to Sequence Learning with Neural Networks (http://arxiv.org/abs/1409.3215)
[2] Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation (http://arxiv…