stereolabs / zed-unity

ZED SDK Unity plugin
https://www.stereolabs.com/documentation/guides/using-zed-with-unity/introduction.html
MIT License
250 stars 57 forks source link

Project Point Cloud to Camera Frustum #267

Closed keli95566 closed 1 year ago

keli95566 commented 1 year ago

Preliminary Checks

Proposal

Hi there! Thank you very much for the great plugin!

I am currently using the ZED_PointCloud.shader and ZEDPointCloudManager.cs to project live point cloud data into a Unity scene.

However, I notice that the point cloud is always projected in the forward direction with respect to Unity world origin. Does anyone know a quick solution how one can project the point cloud to the camera frustum whose poses are tracked and updated all the time?

I believe that in Unity we could use the "Transform.transformpoint" to achieve this, but I guess in this case we need to modify the ZED_PointCloud.shader and would appreciate any hint that could help achieve so !

Use-Case

Project the point cloud to tracked camera frustum so we know the relative spatial location of the point cloud.

Anything else?

No response