RealTimeFaceSwap

Overview

This project is about face-swapping processing in video. Inspirations are iperov/DeepFaceLive and haofanwang/inswapper.

Adopted techniques

• Face detection & face swapping: deepinsight/insightface
  • The model used for swapping is ezioruan/inswapper_128.onnx
• Upsampling of swapped images: sczhou/CodeFormer

Demonstration

Suppose you want to swap your face with the image below,

Source by Pexels.com

InsightFace recognizes your face and replaces yours to the input image.

The swapped image is a little rough and CodeFormers upsamples face area.

Source code

Some codes are borrowed from sczhou/CodeFormer

• basicsr/
• facelib/
• weights/
• FaceRestorationHelperWrapper.py largely stems from inference_codeformer.py

Installation of the required packages

pip install opencv-python torch torchvision insightface

Ref. useful pre-trained models worth trying(I did not though)

Releases/Sapphire