Controllable 3D Generative Adversarial Face Model via Disentangling Shape and Appearance

Fariborz Teherkhani, Aashish Rai, Shaunak Srivastava, Quankai Gao, Xuanbai Chen, Fernando de la Torre, Steven Song, Aayush Prakash, Daeil Kim ( equal contribution)

Carnegie Mellon University, Facebook/Meta

WACV 2023

This is the official Pytorch implementation of the paper.

[Project Page] [Video] [Colab Demo] [Arxiv]

Testing

Conda environment: Refer environment.yml

Download pre-trained weights and put the "checkpoints" folder in the main directory. [Link]

• Generate 3D Faces (mesh and texture)

  python generate_faces.py

• Generate meshes only

  python test_gan3d.py

• Generate textures only

  python test_texture.py

Train your own model

Dataset

We primarily used the FaceScape dataset. It can be downloaded from [Link]. The dataset is restricted to be used for non-commercial research only. Learn more about Facescape License [Link].

Preprocess data

- Download Facescape dataset and specify path to the "facescape_trainset" folder.

python preprocess_traindata.py

Start training

• Shape

  Train AE
  python train_ae.py 

  Generate Reduced Data
  python gen_reduced_data.py 

  Train GAN
  python train_gan3d.py 

• Texture

  Train P-GAN
  python train_texture.py --init_step 1 --batch_size 128

License

The code is available under X11 License. Please read the license terms available at [Link]. Quick summary available at [Link].

Citation

If you use find this paper/code useful, please consider citing:

@InProceedings{Taherkhani_2023_WACV,
    author    = {Taherkhani, Fariborz and Rai, Aashish and Gao, Quankai and Srivastava, Shaunak and Chen, Xuanbai and de la Torre, Fernando and Song, Steven and Prakash, Aayush and Kim, Daeil},
    title     = {Controllable 3D Generative Adversarial Face Model via Disentangling Shape and Appearance},
    booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
    month     = {January},
    year      = {2023},
    pages     = {826-836}
}