search

VIPL-SLP / VAC_CSLR

Visual Alignment Constraint for Continuous Sign Language Recognition. ( ICCV 2021)
https://openaccess.thecvf.com/content/ICCV2021/html/Min_Visual_Alignment_Constraint_for_Continuous_Sign_Language_Recognition_ICCV_2021_paper.html
Apache License 2.0
116 stars 19 forks source link

Pseudo Label #6

Closed hulianyuyy closed 2 years ago

hulianyuyy commented 2 years ago

I'm wondering how to assign labels for frames with CTC loss. It seems CTC Loss can be viewed as sequential SoftMax losses. But the key point is how to obtain the pseudo labels for frames via back propagation. Thanks in advance!

ycmin95 commented 2 years ago

You can refer to this repo, which calculate the gradients of CTC via PyTorch autograd instead of the forward-backward algorithm.

hulianyuyy commented 2 years ago

Thanks again for your kind reply.