What FLAME version used in here?

georgeretsi / smirk

Official Pytorch Implementation of SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesis (CVPR 2024)

https://georgeretsi.github.io/smirk/

MIT License

126 stars 10 forks source link

What FLAME version used in here? #10

Closed yjhong89 closed 1 month ago

yjhong89 commented 1 month ago

Hi! Thanks for sharing great work!

What FLAME version used in SMIRK??

FLAME 2020 / general .pkl ?
I am asking since advanced FLAME versions are updated in https://flame.is.tue.mpg.de/download.php
If I want to use FLAME 2023, need to re-train and re-adjust FLAME parameter corresponding 2023 version??

Thanks!

filby89 commented 1 month ago

Hey, yes smirk is using FLAME2020 / general .pkl. If you want to use FLAME 2023 and you will need to change FLAME.py to load and use the corresponding blendshapes. I am not sure if FLAME 2023 uses the same shape parameters (in which case you need to retrain the shape encoder as well), but you definitely need to retrain the expression encoder.

yjhong89 commented 1 month ago

Thank you!