barisgecer / GANFit

Project Page of 'GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstruction' [CVPR2019]
http://openaccess.thecvf.com/content_CVPR_2019/html/Gecer_GANFIT_Generative_Adversarial_Network_Fitting_for_High_Fidelity_3D_Face_CVPR_2019_paper.html
GNU General Public License v3.0
631 stars 64 forks source link

About the dataset #7

Closed shoukna closed 4 years ago

shoukna commented 4 years ago

Hi @barisgecer, thanks for your brilliant work.

In the paper, you use the Large Scale Face Model for 3DMM shape model and the 4DFAB database. I want to reproduce this paper, but I can not get access to these two datasets, would you please help me how I can get them?

I am looking forward to your reply!

Best regards.

barisgecer commented 4 years ago

Please see #2.

shoukna commented 4 years ago

Thanks for your reply!

Can I use BFM(Basel Face Model) to replace the LSFM dataset? And how I can get the 4DFAB dataset, which can not been found from the Internet.

What's more, I want to ask if the Large Scale Face Model(LSFM) dataset can be purchased? Our laboratory wants to use it for scientific research only.

Best regards.

barisgecer commented 4 years ago

Hi shouka,

Sorry for my late reply. I have been quite busy lately. First of all, I am personally neither holding the license of any of the datasets nor I am the person responsible for these datasets. But I will try to help you with the all information I have. Below my answers:

Can I use BFM(Basel Face Model) to replace the LSFM dataset?

Yes, you can. You can replace LSFM with BFM or any other 3D Face datasets. However, please mind that larger the dataset, more likely to generalize well.

And how I can get the 4DFAB dataset, which can not been found from the Internet.

I am not sure about 4DFAB's public availability. But you can use any expression blend shape model to replace it. Like FaceWareHouse

What's more, I want to ask if the Large Scale Face Model(LSFM) dataset can be purchased? Our laboratory wants to use it for scientific research only.

I am not sure about this either. You can apply to get LSFM shape model here: https://xip.uclb.com/i/healthcare_tools/LSFM.html for free. But I am not sure about the texture model. It is best to ask contacts found here: https://ibug.doc.ic.ac.uk/resources/lsfm/

Hope this helps, Baris

shoukna commented 4 years ago

Thank you so much, this helps me a lot!

As a beginner to the 3D face, I am confused about the UV maps, how can I get the UV maps from 3D datasets, which are input to the GAN network to train?

This question has puzzled me for a long time, I hope you can help me, thank you!

Best regards.

barisgecer commented 4 years ago

Well, it is not that simple to explain on github :). Have a look at below references:

From my point of view, they are the dataset, but it requires a lot of work to acquire UV images from raw 3D scans

shoukna commented 4 years ago

Many thanks for your help, I will try to get it!