search

Unity-Technologies / arfoundation-samples

Example content for Unity projects based on AR Foundation
Other
3.02k stars 1.12k forks source link

ARFoundation TryAcquireLatestCpuImage is not synchronized with ARCamera Pose? #978

Closed a55987482 closed 11 months ago

a55987482 commented 2 years ago

I use render streaming and AR foundation package to build my project, the purpose is to achieve the function of AR remote rendering. The client side collects the modelview matrix, projection matrix, and timestamp, and sends it to the server for scene rendering, and then streaming it to the client side. The scene frame and camera frame will be matched through Timestamp, and the matched frame will be used Shader to merge.

I had the same problem as this discussion thread, the model of the scene frame is not synchronized on the camera frame. The model seems to drift. I have tried all the suggested methods in it, but I still have the same problem. Is there any other solution?

The link is my code. (Client) https://gist.github.com/a55987482/49b9ede2ef1905e9a9f6e78f4b54fb56 PlaceOnPlane.cs is collects the modelview matrix, projection matrix, Timestamp, and sending them to the server. CameraFrame.cs is responsible for storing Camera frame in Dictionary. AnchorSample.cs is responsible for receiving server-side streaming images (each frame includes Timestamp), and uses Timestamp to extract the matching Camera frame, and finally merges through Shader.

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

andyb-unity commented 11 months ago

Closing this issue as your question is beyond the scope of this repository and the supported features of AR Foundation. Best of luck with your project though!