search

MochiDoesVR / Caramel-For-VRChat

A simple full-body tracking solution for VRChat using Apple's ARKit
MIT License
11 stars 2 forks source link

Blank screen in iPhone 13 Pro #4

Closed V1T3X3 closed 3 months ago

V1T3X3 commented 3 months ago

When I sideloaded the app using sideloadly, the preview screen is black. Although, iOS reports that the camera was recently used for capture. iOS version is 17.3.1. Also, does this capture LiDAR depth data for true 3D tracking? Sorry if I'm using the issues tracker wrong, I'm new here.

MochiDoesVR commented 3 months ago

Sorry for the late response. Would you mind sharing a screenshot? Like, is there any UI whatsoever, or just a completely blank page?

Regarding your question about the LiDAR sensor, I'm not sure, as I haven't found anything about this in the ARKit documentation, and I don't currently have a Pro series iPhone to test myself.

V1T3X3 commented 3 months ago

Here's the two views of the app, completely blank. I've verified that it is still sending OSC data to VRChat, albeit inaccurate.

image This is the article that I read that showcases capturing depth using the LiDAR sensor: https://developer.apple.com/documentation/avfoundation/additional_data_capture/capturing_depth_using_the_lidar_camera granted, its about AVFoundation but I tend to hope for the best.

image https://developer.apple.com/documentation/arkit/arframe/3566299-scenedepth There's also the sceneDepth property inside ARKit itself. Perhaps you can use it to guesstimate joint position in 3D space?

Btw, I'm talking out of my ass here. Just hoping this might be the solution for the masses for FBT, even if its a pipe dream.

MochiDoesVR commented 3 months ago

Inaccurate tracking is to be expected, but I couldn't really tell you what's causing the black screen, unless it's some kinda regression linked to iOS 16.x and newer. I haven't really touched iOS development since I released this app, so I can't really do much but offer support.

MochiDoesVR commented 3 months ago

Regarding your question about depth, I was looking into trying to use the faceID sensor, or LiDAR sensor for body tracking by utilizing a custom tracking net a long time ago, but never got around to it because ML looked too confusing lol.

V1T3X3 commented 3 months ago

Fair reasons. Can't really complain since this is a free solution. I think I'll just close this thread with this comment. Hope you good on your future endeavors.