search

SimonGiebenhain / MonoNPHM

[CVPR 2024 Highlight]
https://simongiebenhain.github.io/MonoNPHM/
Other
113 stars 20 forks source link

Overlaying generations to image/video directly #24

Open dondongwon opened 1 month ago

dondongwon commented 1 month ago

Hi, is there any way to overlay the reconstructions(mesh) to the image, as you've done in your demo videos?

image
SimonGiebenhain commented 3 weeks ago

You "just" need to figure out how to move mesh from model-space to camera-space using the head pose. Then you can render the mesh using the same intrinsics that is used during tracking. You might just need to convert between OpenGL and OpenCV