CurvSurf / FindSurface-visionOS

FindSurface library for visionOS, distributed as a Swift package.
MIT License
10 stars 1 forks source link

Can I use it in unity development for VisionOS? #1

Open CJMmsz opened 3 weeks ago

CJMmsz commented 3 weeks ago

Hello,bro.We are using unity to develop for VisionOS.We are now searching for resolution to render PointCloud in VisionPro by using unity,but all the plugins we found in unity asset store only supported windows.Another resolution is to make a plugin ourselves to get access to pCloud,but it's hard work.We are glad to see your codes,but how can I use them in unity? as they are swift languages. We would appreciate it very much if you could us answers

GooksanGom commented 9 hours ago

Unfortunately, I don’t think our code will be of much help for what you’re trying to achieve. While the code in our sample project does render point clouds to demonstrate the functionality of FindSurface (a software library that extracts geometric information from point cloud data), the point cloud in our project is not derived directly from depth data or point clouds from the Apple Vision Pro’s LiDAR sensor (as Apple does not provide such data). Instead, it visualizes vertices obtained from ARKit’s MeshAnchors using RealityKit.

I’m not very familiar with Unity development for visionOS, but based on a brief search, it seems that for rendering, developers use a framework called PolySpatial in C#, similar to how RealityKit is used in Native (Swift) development. From what I could gather, the functionality provided by PolySpatial alone does not provide access to the necessary point data from MeshAnchors, as we did in our sample project. I also learned about the ARKit XR Plugin, a Unity plugin that might provide access to point cloud data. However, upon further research, it might not be what you’re looking for, as this plugin seems to be intended for iOS (it’s unclear whether it supports visionOS), and since visionOS does not directly provide depth data or point clouds, this limitation likely makes it inapplicable.

During the search, I've seen a couple of resources for better methods of rendering point clouds in Unity, which you can explore by searching for “Unity point cloud rendering.” As for accessing point cloud data in a Unity project for visionOS, this is beyond the scope of what we can offer, and you might need to explore this further on your own.