MCG-NJU / SADRNet

[TIP 2021] SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Apache License 2.0

127 stars 27 forks source link

Instruction for running this open source code #29

Open ken881015 opened 10 months ago

ken881015 commented 10 months ago

I follow README.md for loading checkpoint "net_021.pth" prepared by author but the process is not that smoothly. So I record what I have done for fix those problem.

Info

Done: Not Yet

Environment

I follow requirement.txt for install packages I needs for running by conda.
Every package installed are followed requirement.txt, and here is something you should noticed!

Torch version

torch is 1.2.0, and the version has vital effect when you load "net_021.pth" as pre-trained checkpoint. Just as this guy mentioned, different version of torch have different strategy for convolution operation. So if you what to use pre-trained model "net_021.pth". Notice your yorch version.

How about running by newest torch such as 1.17.0 or 2.0.0?

the method of fixing mis-match of feature map size from the message below.
- I just turn self.conv2 in ResBlock4 from conv4x4 to conv3x3, and you can get a well-function but untrained model.
- And maybe you can train it now ? (I haven't do this yet)

Numba

Error msg of numba may related to the version of its dependent package not listed in requirement.txt: llvmlite==0.32.1

Inference

In README.md chapter Predicting
- the step are too simple for follow currently, and if you are using other data not belong to AFLW2000-3D or 300w-lp, you can't get what you want....

Predicting AFLW2000-3D

original command is only suitable for AFLW2000-3D or 300w-lp which has go through pre-process by prepare_dataset.py
- Like this
- And get this

How to predict our own data?

The most easy way is
- Put jpg file (ex. name.jpg) in data/example/name
- Add a if here:
  - "src/dataset/dataloader.py; class ImageData; func read_path; before loadmat function line 41 "
  - And you can predict whatever you want!!

Face-Profiling Algorithm and 'data/dataset/Extra_LP' ?

Undone....

Welcome for any discussion. Hope we can fight together!!!

WZUchen commented 6 months ago

Hello! I hope I'm not disturbing you. May I ask if it's necessary to preprocess the JPG files before placing them in the data/example/name directory? @ken881015