hulianyuyy / CorrNet

Continuous Sign Language Recognition with Correlation Network (CVPR 2023)
84 stars 14 forks source link

Calculate the delta t #36

Closed atonyo11 closed 5 months ago

atonyo11 commented 5 months ago

https://github.com/hulianyuyy/CorrNet/blob/9ad569727be617cf614b19aecb79b8e625a9bd7d/dataset/dataloader_video.py#L129-L140

Hi author, I did not understand why we do that. Can you explain how to calculate the delta t? For example C5-P2-C5-P2? Thank you in advance!

image

hulianyuyy commented 5 months ago

The padding after a C5 is (5-1)/2 = 2. After P2, it becomes 22=4. After C5, it becomes 4+2=6. Finally after P2, it becomes 62=12. This is the calculation process of the padding, which may have different meanings with delta t in your picture.

atonyo11 commented 5 months ago

I got it. Thank you!