AILab-CVC / UniRepLKNet

[CVPR'24] UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition
https://arxiv.org/abs/2311.15599
Apache License 2.0
863 stars 52 forks source link

论文里面的一个问题 #4

Closed EveningLin closed 6 months ago

EveningLin commented 7 months ago

image image 是不是写错了(5,5,3,3)?

EveningLin commented 7 months ago

image 请问(k−1)r + 1是怎么得出来的

EveningLin commented 7 months ago

image 请问这里droppath为什么要递增呢

DingXiaoH commented 6 months ago
  1. 是论文里这个数字写错了,请以code为准。
  2. 可以想象,kernelsize为k的时候,kernel两个边(如最左边到最右边)之间的距离是k-1个点,dilation=r使得这个距离膨胀到了r倍,所以是(k-1)r,再加上中间点,kernelsize就是(k-1)r+1
  3. 这是至少从Swin开始,可能更早,的common practice
zpc-666 commented 6 months ago

image 请问这里droppath为什么要递增呢

这个地方是Deep Networks with Stochastic Depth这篇提出来的,这里pl是存活率,等于1-dp_rate 1703584131679