search

rshaojimmy / MultiModal-DeepFake

[TPAMI 2024 & CVPR 2023] PyTorch code for DGM4: Detecting and Grounding Multi-Modal Media Manipulation and beyond
Other
369 stars 28 forks source link

How to get the region of FA? #10

Closed BubbleSai closed 1 year ago

BubbleSai commented 1 year ago

Hi, I was wondering how to get the region of FA. In the paper's Section 3.2 (Face Attribute Manipulation), the author mentioned, "we first predict ..... using GAN-based methods". Can I understand this as the author first applies an expression detector to the face to get the expression region (e.g., "smile mouth"), then employs StyleCLIP to modify the expression of the face, and finally replaces the original expression region with the modified expression region?

How many face attributes does the dataset provide (e.g., "smile to angry")? what is the expression detector? and is the process of replacing as simple as copy and paste?

Thanks!

rshaojimmy commented 1 year ago

Hi, please check out the extension of our paper: https://arxiv.org/pdf/2309.14203.pdf and I think you could get the answers from it.

Thanks.