FuxiCV / MeInGame

MeInGame: Create a Game Character Face from a Single Portrait, AAAI 2021
MIT License
653 stars 119 forks source link

Question about shape transfer function #18

Open WANGEOGEO opened 3 years ago

WANGEOGEO commented 3 years ago

Hi guys,

While I was going through the paper, I found the definition of RBF interpolation mentioned in 3.3 shape transfer part is kind of confusing for me.

I know that x' are the 68 face landmarks on the game mesh, but what about the input x? In the paper it says ' input x is set to the original position of a game mesh vertex'. Does it mean that x represents vertexes on the game mesh? But if this is true, how can we make f(x) the transfer which is able to transfer the original 3DMM mesh into the game mesh? I'm quite confused about this part.

Thanks in advance for anyone who helps me.

qiuyu96 commented 3 years ago

You need to know RBF Interpolation. x' and x are the vertices of the game mesh, suppose y' and y are the corresponding vertices of the original face mesh. Given x' -> y', we can calculate the other vertices(i.e. x) position of the game mesh using RBF Interpolation.