yinanhe / ForgeryNet

[CVPR 2021 Oral] ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis
100 stars 4 forks source link

about your dataset for Image Forgery classification #9

Closed xuanli98 closed 3 years ago

xuanli98 commented 3 years ago

Thanks for your great work. I have some questions about your dataset for Image Forgery classification. Q1: Would you like to tell me if there are multiple faces in a single frame in your training data for Image Forgery classification ? Q2: Do some pictures like this have faces? Or is it just one of the perturbations? I find it is just green and blue. data comes from test data downloaded from https://drive.google.com/file/d/1conYQXWguAwJ1eEwewHyMBGUtgjgR_sM/view?usp=sharing :f7d916050dfb89147167eabb15124458.jpg, 0c6e1e7d95fe1448c7114bfb46d47ef8.jpg 0c6e1e7d95fe1448c7114bfb46d47ef8 f7d916050dfb89147167eabb15124458

yinanhe commented 3 years ago

A1: We detect faces from images in image-origin by RetinaFace [16] for future manipulation. As shown in Fig. 2 in the main paper, in some scenarios, multiple faces co-occur in a single frame, such as “conversation between two or more people” or “crowd gathering”. To determine the target face for forgery, we first use a simple IoU (Intersection-over-Union) based tracking to acquire face tubes each with faces of the same person identity. We select the face which appears most frequently in the video, i.e. has the longest face tube.

A2: They are error distortion when extracting frames from video.