A question about how to use multi-camera images（like 4 images） to reconstruct cloth body？

[xkkjiayou]

hi yuliang, thank u for your amazing job.i have a question abou multi-camera.hope u can answer or give me some suggestions,very thank u.

now,the model(ECON) input is 1 image. But in my project , i can offer 4(or more) images, how can i use 4 images(front, back ,left-side,right-side) to reconstruce 1 cloth body ?

现在ECON的模型输入是1张单视角的rgb图，在我的项目中，我会有4个相机，同时对一个人的四个面进行拍照（正面、背面、左侧、右侧），我期望能够把这4张图共同输入进网络，以获取纹理更好的人体三维模型。我应该怎么做？希望yuliang能够指点迷津，非常感谢！

[xkkjiayou]

非常感谢！

[YuliangXiu]

This is out of the scope of ECON, you could check NeuS [1], NeuralUDF [2], Zins et al [3], as reference.

[1] Wang, Peng, et al. "Neus: Learning neural implicit surfaces by volume rendering for multi-view reconstruction." arXiv preprint arXiv:2106.10689 (2021). [2] Long, Xiaoxiao, et al. "NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies." arXiv preprint arXiv:2211.14173 (2022). [3] Zins, Pierre, et al. "Data-driven 3D reconstruction of dressed humans from sparse views." 2021 International Conference on 3D Vision (3DV). IEEE, 2021.