search

VCL3D / VolumetricCapture

A multi-sensor capture system for free viewpoint video.
https://vcl3d.github.io/VolumetricCapture
487 stars 66 forks source link

Streaming live data #92

Closed bipul-mohanto closed 1 year ago

bipul-mohanto commented 1 year ago

Hi! I already checked previous issues related to streaming live volumetric data, maybe it is not possible with the current software, or maybe a little hope left!

I have the intel nukes and cameras in another room and want to get (1) the data stream from another room under the local network, in addition, I want to (2) visualize the 3D point cloud streaming live. Would you like to give any suggestions on the 2nd part?

bipul-mohanto commented 1 year ago

Something like this, https://vcl3d.github.io/AVoidX/, in this paper they have fed the real-time RGB-d data to the unity3d game engine. So, I believe, it is also possible to access the point cloud data to PyTorch. Any suggestions?

ankarako commented 1 year ago

Hi bihul,

As we already discussed you cannot stream the point-cloud data. However, you may be able to do what you need in an offline manner. You could capture a sequence, dump the RGB-D data, and use the dumped data in a pytorch workflow.

bipul-mohanto commented 1 year ago

Hi @ankarako,

Thanks for your feedback. Just one more question regarding the streaming, I saw the AVoidX game from your lab where the cameras are streaming the data live to Unity3D, isn't it?

ankarako commented 1 year ago

You are correct, but this feature is not available in the volcap releases on github.

bipul-mohanto commented 1 year ago

Actually, we desperately need that feature, not for playing games, but 3D streaming on Unity3D, or even better, if could do it in PyTorch. Looking forward to your suggestions.