search

ashawkey / RAD-NeRF

Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decomposition
MIT License
878 stars 153 forks source link

Torso is moving #29

Open Souvic opened 1 year ago

Souvic commented 1 year ago

Is it possible to stabilize the output somehow? The torso is still moving randomly (not a lot but I thought this paper has dealt with the unnecessary movement of the torso)

Can I use a static image removing the torso with only a stable frame? Or is there any image stabilization method you know?

Souvic commented 1 year ago

After fixing the data_range to 0,1 .. the torso is fixed. The head is still moving randomly, though little but visibly.

ulucsahin commented 1 year ago

Have you managed to stabilize head, or is it looking any bad in its current version with stabilized torso?

ashawkey commented 1 year ago

@Souvic Hi, what is the dataset? If the head still shows severe flickering at a fixed pose, you can try to increase lambda_amb in training, which regularize unnecessary dynamics outside face region.