search

ashawkey / RAD-NeRF

Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decomposition
MIT License
878 stars 153 forks source link

请教如何微调头部姿势 #41

Open kendo6666 opened 1 year ago

kendo6666 commented 1 year ago

我训练出的所有模型，头部总是有轻微的前后晃动，感觉很不自然，很奇怪，请问这个有办法微调吗？

ashawkey commented 1 year ago

@kendo6666 You may check the type of flickering:

  1. Flickering when you even fix the head pose: applying a larger lambda_dynamic during training.
  2. Flickering caused by inaccurate head pose estimation: search the smooth_path option and use a larger smooth window size.
yerfor commented 1 year ago

Hi, can you describe what is the lambda_dynamic? I wonder is it lambda_ambient since I cannot find a variable named lambda_dynamic

ashawkey commented 1 year ago

@yerfor Yes you are right. It's called dynamic loss in the paper.

zhangziliang04 commented 1 year ago

@kendo6666 You may check the type of flickering:

  1. Flickering when you even fix the head pose: applying a larger lambda_dynamic during training.
  2. Flickering caused by inaccurate head pose estimation: search the smooth_path option and use a larger smooth window size.

第二参数找到了。第一个lambda_dynamic 从哪儿调整？没搜索到啊。