Simple 3D-GAN-PyTorch

Introuction

• This is a very simple-to-use pytorch implementation of part of the paper "Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling". I provide the complete pipeline of loading dataset, training, evaluation and visualization here and also I would share some results based on different parameter settings.

Updates

• 07/2024: added convert.py to convert .off files to .mat files; you can download the ModelNet data from kaggle.
• 10/2021: Refactored code, updated readme and provided a pretrained model.
• 03/2021: Added gitignore, removed some unrelated files, updated prerequisites to python 3.7.9 + pytorch 1.6.0, fixed mplot3d.

Prerequisites

• Python 3.7.9 | Anaconda4.x
• Pytorch 1.6.0
• tensorboardX 2.1
• matplotlib 2.1
• visdom (optional)

Pipeline

Basically I already put the chair dataset and a trained model as an example in volumetric_data and outputs folders. You can directly go to the training or evaluation part. But I still give a complete pipeline here.

Data

• We provide the chair dataset in volumetric_data folder from ModelNet. As we use ModelNet instead of ShapeNet here, the results may be inconsistent with the paper.

Training

• Then cd src, simply run python main.py on GPU or CPU. Of course, you need a GPU for training until getting good results. I used one GeForce GTX 1070 in my experiments on 3D models with resolution of 32x32x32. The maximum number of channels of feature map is 256. Because of these, the results may be inconsistent with the paper. You may need a stronger one for higher resolution one 64x64x64 and 512 feature maps.

• During training, model weights and some 3D reconstruction images would be also logged to the outputs folders, respectively, for every model_save_step number of step in params.py. You can play with all parameters in params.py.

Evaluation

• For evaluation for trained model, you can run python main.py --test=True to call tester.py.
• If you want to visualize using visdom, first run python -m visdom.server, then python main.py --test=True --use_visdom=True.
• We provide some sample results in the following and in the sample_results folder.

Pretrained Model

• We provide a pretrained model here. Download, unzip and put it into the outputs folder. Then run python main.py --test=True --model_name=dcgan_pretrained. You will find the outputs in the test_outputs folder within dcgan_pretrained.