-
# 論文リンク
https://arxiv.org/abs/2001.04451
# 公開日（yyyy/mm/dd）
2020/01/13
# 概要
・計算コストの高い Transformer の計算効率効率のための手法を 2つ提案
・内積注意 → 局所性鋭敏型ハッシュを使用して計算量オーダーを O(L^2) から O(L log L ) に削減 (L はシーケンス長)
…
-
Hi,
Since you are the blog entry author I reference you @patrickvonplaten in this issue.
With great interest I read the blog entry on the Reformer model ([https://huggingface.co/blog/reformer](…
-
It would be great if pretrained Reformer models become available (e.g., trained on BooksCorpus and English Wikipedia).
-
### Issue description
pypots/nn/modules/reformer/local_attention.py:31: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead
Ma…
-
**Describe the bug**
AI doesn't cast Calibrated Blast if the player gets hexproof/shroud from his creature, although the AI can kill that creature with Calibrated Blast and thus deprive the player of…
-
In https://github.com/quintel/etsource/commit/bcfc262f194d24a0d631d9c1ece120bfcc88ad8b the dataset-specific attributes for SMR and biomass gasification were removed and set to hardcoded values. These …
-
Thanks for this repo. Is there a possibility of adding your existing [local attention](https://github.com/lucidrains/local-attention) and [reformer](https://github.com/lucidrains/reformer-pytorch) imp…
-
@lucidrains Tried reformer as you have suggested...Results were also not very impressive, unfortunately... In fact, I am getting much better results with the official Google implementation of Reformer…
-
Coming from tensor2tensor I was wondering whether the Reformer model would be also a candidate for speech recognition? Looking at the examples there is none for ASR.
Would it be possible to train a…
-
- https://arxiv.org/abs/2107.14178
- 2021
画像キャプションは、画像内のオブジェクトの関係性を表すためにシーングラフを使用することで、より優れた性能を達成できることが示されている。
現在のキャプション・エンコーダは、一般的に、グラフ・コンボリューショナル・ネット（GCN）を用いて関係情報を表現し、それをオブジェクト領域の特徴と連結または畳み込みによ…
e4exp updated
3 years ago