search

Rubikplayer / flame-fitting

Example code for the FLAME 3D head model. The code demonstrates how to sample 3D heads from the model, fit the model to 3D keypoints and 3D scans.
http://flame.is.tue.mpg.de/
733 stars 111 forks source link

model.weights format #42

Open ArjunZ786 opened 1 year ago

ArjunZ786 commented 1 year ago

Hello,

Thanks again for this wonderful work!

I understand that model.weights:(5023, 5). I wanted to know what each of those 5 weights per vertex represents.

TimoBolkart commented 1 year ago

Hello, FLAME uses linear blendskinning (LBS) to articulate the head rotation around the neck, the jaw rotation, and to rotate left and right eye. The model.weights are the LBS blendweights (5 because of the 5 joints to rotate around). For a mathematical formulation please see the description in Eq. 2 of the SMPL paper