issues
search
junxnone
/
aiwiki
AI Wiki
https://junxnone.github.io/aiwiki
18
stars
2
forks
source link
ML Transformer Vision
#226
Open
junxnone
opened
3 years ago
junxnone
commented
3 years ago
Transformer 在视觉方面的应用
Reference
2021-01 A Survey on Visual Transformer [
Paper
] [
Note
]
2021-01 Transformers in Vision: A Survey [
Paper
] [
Note
]
vision_transformer - google-research
DETR
LSTR: Lane Shape Prediction with Transformers
-
Github
vit-pytorch
x-transformers
linformer
self-attention-cv - The-AI-Summer
Brief
Classification
CNN Vs Transformer
CNN Vs Transformer
不同点
CNN
参数共享, Local 信息聚合
Transformer
全局感受野, Global 信息聚合
Name
Description
CNN
Transformer
ViT
❌
✅
DETR
✅
✅
BoTNet
✅
✅
T2T-ViT
❌
✅
DeiT
❌
✅
Classification
Models
ViT
T2T-ViT
DeiT
W/ Efficient Attention
Linformer
Routing Transformer
Sinkhorn Transformer
Nystromformer
OpenSource Code
timm
release with pretrained weight
vit-pytorch
module
vit_pytorch =>
vanilla vit
distill
DistillableViT
t2t
T2TViT
efficient => 自定义的 Transformer module
Linformer
Nystromformer
junxnone
commented
3 years ago
junxnone/aiwiki#212
Transformer 在视觉方面的应用
Reference
Brief
CNN Vs Transformer
Classification
Models
OpenSource Code
vanilla vit