How extract FLAME parameters (expression, jaw) from vertex offset.

TimoBolkart / voca

This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh.

https://voca.is.tue.mpg.de/en

1.17k stars 273 forks source link

Open yjhong89 opened 4 months ago

yjhong89 commented 4 months ago

Hi!

My model predicts vertex offset (5023, 3) from template.npy (I am doing Audio-to-FLAME model)
Is there any way extracting expression and jaw FLAME parameters from those vertex offset ??

Thanks!

linwei5d commented 3 months ago

Same question, wanting to apply these parameters directly to the official example Unity project of Flame (10 Expression Parameters)