ICT-VGL / ICT-FaceKit

ICT's Vision and Graphics Lab's morphable face model and toolkit
MIT License
642 stars 111 forks source link

Identity PCA modes are not orthogonal ? #19

Open spaceapple opened 3 years ago

spaceapple commented 3 years ago

Hi, Thanks for the awesome work, the data and code are super useful.

Something is bothering me though. It's my understanding that the identifyXXX.obj files store the identity PCA modes. So, I'd expect those to be orthogonal to eachother. In code

import face_model_io
face_model = face_model_io.load_face_model('../FaceXModel')
mode_dotproduct = np.sum( face_model._identity_shape_modes[0] * face_model._identity_shape_modes[1])

I'd expect mode_dotproduct to be zero (or very close to it), but it's not the case. I get

>>> mode_dotproduct
0.0005141700283957107

The same goes for all combinations of shape modes. So they're not PCA eigenvectors ?

SunMoonDev commented 1 year ago

maybe the obj is not complement equal to the original pca result. maybe there are some postprocess apply to the original pca result