search

radekd91 / inferno

🔥🔥🔥 Set the world of 3D faces on fire with INFERNO 🔥🔥🔥
Other
177 stars 21 forks source link

The technical details of EMICA? #30

Open weihaosky opened 2 weeks ago

weihaosky commented 2 weeks ago

Thanks for this excellent work! In the readme, it says EMICA is a combination of DECA, EMOCA, SPECTRE, and MICA, but without any details. May I ask how do you combine these methods to propose EMICA? Is there any documents (e.g., paper, technical report) introducing the EMICA? Many thanks!

radekd91 commented 2 days ago

In short, MICA's prediction for shape, another encoder that predicts camera and pose, and one more encoder that predicts the expression, that one is supervised with EMOCA's and SPECTRE's loss.

There is no paper or technical report. It's just a bit of engineering combining existing papers together. You can use it through the FaceReconstruction demos. If interested, you can step through the code.

weihaosky commented 2 days ago

Thanks for explaining! Did you train the encoder that predicts the expression from scratch?