search

ThibaultGROUEIX / AtlasNet

This repository contains the source codes for the paper "AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation ". The network is able to synthesize a mesh (point cloud + connectivity) from a low-resolution point cloud, or from an image.
http://imagine.enpc.fr/~groueixt/atlasnet/
MIT License
677 stars 119 forks source link

Mapping 2d to 3d #50

Closed xiang-zhu127 closed 3 years ago

xiang-zhu127 commented 4 years ago

Hello, I was wondering if there is any way to map part of a 2d image to the 3d mesh generated. like for the airplane, can i automatically map the left wing in the image to the left wing of the mesh etc..

Any help would be appreciated thanks.

ThibaultGROUEIX commented 4 years ago

Hi @xiang-zhu127, This is beyond the scope of the current code.

One possibility would be to reproject the generated mesh to the image and use the reprojection to texture the mesh. This would work if the generated mesh were in image coordinates which is not the case in this code. The meshes are predicted in a canonical frame. Other works showed that AtlasNet can also generate meshes in image coordinate, but you would have to change the code and retrain the method.

Hope this helps, Cheers