Brummi / MonoRec

Official implementation of the paper: MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Camera (CVPR 2021)
MIT License
587 stars 85 forks source link

Realtime #45

Closed TuskAW closed 1 year ago

TuskAW commented 2 years ago

Hello. I wanted to ask about how suitable MonoRec could be for realtime reconstruction. Any information will be greatly appreciated.

Brummi commented 2 years ago

Hi TuskAW,

thanks for your interest in our work! In our experiments, we were able to get 10+ FPS on a 12GB Titan. This assumes that you data loading takes very little time. I am sure this could be optimized further. Also, the configuration plays a big role (we use 32 depth planes, but you could try less)

Best, Felix

TuskAW @.***> schrieb am Fr., 14. Okt. 2022, 00:07:

Hello. I wanted to ask about how suitable MonoRec could be for realtime reconstruction. Any information will be greatly appreciated.

— Reply to this email directly, view it on GitHub https://github.com/Brummi/MonoRec/issues/45, or unsubscribe https://github.com/notifications/unsubscribe-auth/AD4X7BFUCJ375HN6FM2A6X3WDCBYZANCNFSM6AAAAAAREWKCPU . You are receiving this because you are subscribed to this thread.Message ID: @.***>

TuskAW commented 2 years ago

Thanks for the quick reply. My use case would be to use realtime video from a zed/real sense camera and reconstruct the 3D scene, including dynamic objects, such as cars, people, etc. I would have the camera in a fixed location at first, but will want to have it on a moving platform. The hardware would not be a problem; however, frame rate would be important. 10 fps may be a good starting point, but ideally, 30 fps would be the sweet spot for my project.