search

patrikhuber / superviseddescent

C++11 implementation of the supervised descent optimisation method
http://patrikhuber.github.io/superviseddescent/
Apache License 2.0
402 stars 188 forks source link

Minimize Landmark detection Jitter #34

Closed Larumbergera closed 7 years ago

Larumbergera commented 7 years ago

Hi Patrik,

I have run a landmark detection with your pre-trained model "face_landmarks_model_rcr_68.bin" to a Still Face video (done synthetically) and I have seen that in each frame, the Landmarks' position is different. I want to minimize the diference between frames.

I think detect landmarks 'x' times and average each frame should minimize jitter.

So, what do yo think about this solution? Do you think there is a better way to minimize it? Is it possible to train a model with less jitter?

Regards,

Andoni.

patrikhuber commented 7 years ago

Hi,

I think that usually people just smooth the detections, i.e. a moving, weighted average or something like that. Every landmark detection/tracking algorithm I've seen so far has jitter, even commercial ones, and most use some kind of smoothing, as far as I am aware, so the jitter is reduced/gone in the end result (at the cost of a slight latency).

Larumbergera commented 7 years ago

Thanks a lot!