search

EvelynFan / FaceFormer

[CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers
MIT License
778 stars 133 forks source link

Why does PeriodicPositionalEncoding have a dropout? #47

Open JeremyCJM opened 1 year ago

JeremyCJM commented 1 year ago

Hi Evelyn,

Why does PeriodicPositionalEncoding have a dropout?

Thanks, Jeremy

EvelynFan commented 1 year ago

Hi Evelyn,

Why does PeriodicPositionalEncoding have a dropout?

Thanks, Jeremy

Hi, this follows the default setting in the original position encoding of transformer. The class PositionalEncoding(nn.Module) has a dropout (https://github.com/pytorch/tutorials/blob/master/beginner_source/transformer_tutorial.py).