warmshao / FasterLivePortrait

Bring portraits to life in Real Time!onnx/tensorrt support!实时肖像驱动!
507 stars 48 forks source link

Any way to ease the live camera flicking #28

Open westNeighbor opened 3 months ago

westNeighbor commented 3 months ago

This work is superb. Seems all the AI motion capture has the flicking problem, I am wondering can it be eased by giving a threshold of math::abs(the markers' location of current frame minus location of previous frame)?

warmshao commented 3 months ago

This work is superb. Seems all the AI motion capture has the flicking problem, I am wondering can it be eased by giving a threshold of math::abs(the markers' location of current frame minus location of previous frame)?

It is possible, for example, smooth algorithms based on optical flow.

It is possible, such as smoothing algorithms based on optical flow.