search

georgeretsi / smirk

Official Pytorch Implementation of SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesis (CVPR 2024)
https://georgeretsi.github.io/smirk/
MIT License
126 stars 10 forks source link

about smirk_generator #7

Open ak01user opened 2 months ago

ak01user commented 2 months ago

Hi!I'm very interested in smirk_generator.

it could re-generate the entire face very well.I noticed that the covered part is not completely black. It randomly samples the relevant information of the original image. I want to know what the training process of this model is.

image

filby89 commented 2 months ago

Hey @ak01user thanks for your interest in SMIRK ! You can find more info on exactly how we sample points from the face in our publication: https://arxiv.org/abs/2404.04104 (Section 3.2.1 and A.2. This process in the code starts here: https://github.com/georgeretsi/smirk/blob/main/src/smirk_trainer.py#L262

fullstack-dev0727 commented 2 days ago

Hi, @filby89 @ak01user I am very interested in smirk_generator. The reconstructed image seems like to be blurry. Is any solution to fix this problem?