-
### 🐛 Describe the bug
There are following issues:
- passing `Parameter` as argument instead of `Tensor` causes recompilation
- setting `torch._dynamo.mark_dynamic` on `Parameter` has no effect
- …
-
## Abstract
- self-attention is strong, but its effect on long-range dependency is in question
- propose `lightweight convolution` and `dynamic convolution`, a convolution as a function of timestep …
-
## 一言でいうと
Self-Attentionは強力だが、1:N(自分vsその他)の計算が必要でコストが高い。単にAttentionをタイムステップごとに予測するだけでも、同等の性能が得らるという研究。畳み込みはDepthwiseでカーネルの重みをAttentionライクに正規化するのが基本だが、この重みを動的に計算する
![image](https://user-images.gi…
-
## ざっくり言うと
- NLPでself-attentionが流行っているが,それに変わってlightweight convolutionとdynamic convolutionを提案
- self-attentionと異なり,系列全体の情報は使わない.それでいて匹敵する性能
- 入力系列長Nに対してO(N^2)で計算量が増えるself-attentionに対して,提案した2つはO(N)で…
-
[Yu-Freeform Image inpainting-iccv-2019] discusses feature-wise gating for dynamic feature selection. It provides a very good explaination on various convolutions, compared to the vanilla spatially-un…
-
Following the tutorial at https://packaging.python.org/en/latest/tutorials/packaging-projects/, I created the following [`pyproject.toml`](https://github.com/tbenst/safari/blob/cb666bceefad1bbfe5ea9a3…
-
As an extension of our past clustering attempts (dynamic-gcnn [here](https://github.com/DeepLearnPhysics/dynamic-gcnn) and [there](https://github.com/Temigo/nu-net), as well as Dae Hyun's recent attem…
-
#### Related to Community Detection
- Large graph visualization using community detection
- Circling a set of nodes with a boundary such that obstruction is proportional to BFS
- [Nearly Balanced…
-
Excellent work !!!
Recently I have studied your paper and code , which is very enlightening to me. I sincerely think that your work is of great significence for us to study the dynamic convolution…
-
In the examples of lightweight and dynamic convolutions, to install the light/dynamic convolutions I ran the scripts:
```
python cuda_function_gen.py
python setup.py install
```
However I got t…