Open lucasjinreal opened 1 year ago
Thanks for your attention. To build the 3D-ETF dataset, we collected a large amount of audio-blendshape data that enables our network to learn the mapping from audio to blendshape coefficients. Our dataset will be released later.
@ZiqiaoPeng thanks for your reply, does your blendshapes compatible with arkit?
Yes, our blendshapes and arkit’s blendshapes are compatible, and they can be driven directly using the plugin in UE.
@ZiqiaoPeng looks promising, how did u collected the data? Does it can be directly using with metahuman?
I asked our team of animators in detail, and they said that the 52 blendshape output can be used directly in metahuman, and we are developing a higher precision blendshape driver algorithm.
@ZiqiaoPeng thanks, hoping for you release code and data soon. still, wanna ask 2 questions:
How to outputs ARKit blendshapes?