SamsungLabs / DINAR

Inference code for "DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars"
Other
102 stars 6 forks source link

Can we use custom dataset? #3

Open MilesTheProwler opened 1 year ago

MilesTheProwler commented 1 year ago

Hi, thank you for sharing your work. I have several questions about your model.

First of all, I want to about can I use my own custom dataset to test your model? Secondly, can I get 3D obj file as an output ? Thirdly, this model can output texture png (texture generation) or does it just use Vertex color in 3D?

Thanks.

david-svitov commented 1 year ago

Hi, 1) Sure, you can check the dataloader code here: https://github.com/SamsungLabs/DINAR/blob/main/dataloaders/from_folder.py  Then you have two options. 

2) No. Unfortunately, our method is for rendering and doesn't produce a 3D model in the process. 3) The model produces a 21-channeled texture. 3 of them are RGB. But for rendering, it's necessary to use all 21 channels and a neural renderer.

kamimachi commented 1 year ago

@david-svitov Hi, Can I get the output of the UV map

david-svitov commented 1 year ago

@kamimachi What do you mean by UV map output? Do you need a sampled RGB texture? Please have a look at this function: https://github.com/SamsungLabs/DINAR/blob/bfd563adbf06b4f0aa70fe330870dbcd70ae1e54/utils/image_utils.py#L229

kamimachi commented 1 year ago

@david-svitov Thank you! that's exactly what I was looking for.