AliaksandrSiarohin / monkey-net

Animating Arbitrary Objects via Deep Motion Transfer
467 stars 81 forks source link

Mask Embedding #30

Open jovis-gnn opened 3 years ago

jovis-gnn commented 3 years ago

First of all, thank you for opensouring amazing code.

I have a question with Mask Embedding. For mask embedding, I've checked that difference of gaussian kp heatmap and deformed source image are needed(to concatenate).

  1. What's your intent behind this movement encoding? Is there any reference of this?

  2. Through Same block and Hourglass prediction, how can movement encoding act as a mask?

Thank you!