TwinTex: Geometry-aware Texture Generation for Abstracted 3D Architectural Models

Official Implementation for our paper "TwinTex: Geometry-aware Texture Generation for Abstracted 3D Architectural Models" (ACM SIGGRAPH Asia 2023).

SOP_TwinTex

Prerequisites

• Environments: Windows10/11, Houdini version>=19.5.x

Installation

Copy our dlls and paste to the following folder C:\Users\xxx\Documents\houdini19.5\dso :

----dso
 ├──SOP_TwinTex.dll
 ├──libgmp-10.dll
 ├──opencv_world460.dll

Then you can search TwinTex in Houdini and add our tool as a node.

Usage

1. Config File: Specify the configuration file default_config.yaml.

2. Scene Path: Specify the path to the data directory, which is structured as follow:

   ----
   ├──Mesh
      ├──original_mesh.ply
      ├──simplify_mesh.ply
      ├──simplify_mesh_sub.ply
   ├──Scene
      ├──XXX.JPG
      ├──XXX.CAM
   ├──Results(auto）

3. Load Data: Load scene data.

4. (Optional) Load Results: Load the results in Result\final_result.

5. (Optional) Show Views: Show the position and direction of the views.

6. (Optional) Show Image: Show the output images of ViewSelection or ImageStitching.

7. ViewSelection: Modify parameters of ViewSelection and apply ViewSelection.

8. ImageStitching: Modify parameters of ImageStitching and apply ImageStitching.

9. Inpainting

   • MMRP Path: Specify the path of the Pre-trained MMRP model. More details of MMRP could be found here.
   • Inpainting: Inpaint the empty regions via MMRP.

10. Start: Apply ViewSelection and ImageStitching.

TwinTex should run the following modules in order: Load Data -> ViewSelection -> ImageStitching -> Inpainting.

After loading neccesary data, please first press Start button to run ViewSelection and ImageStitching. Then you may press Inpainting button to run the inpainting modules if you find any empty regions in the texturing result.

If Houdini crashes, please first check that you followed the above steps.

License

Copyright (c) 2023 VCC. All rights reserved.

Citation

If you find TwinTex useful for your research, please cite the following paper.

@article{TwinTex23,
title={TwinTex: Geometry-aware Texture Generation for Abstracted 3D Architectural Models},
author={Weidan Xiong and Hongqian Zhang and Botao Peng and Ziyu Hu and Yongli Wu and Jianwei Guo and Hui Huang},
journal={ACM Transactions on Graphics (Proceedings of SIGGRAPH ASIA)},
volume={42},
number={6},
pages={},
year={2023},
}