We developed this tool because we wanted to experiment with new AR ideas faster. By capturing an ARKit session (including its depth data, its segmentation masks, all of its positional and orientation streams, stereo microphone audio, and any detected planes) we can reconstruct it in Blender. Once in Blender, we can quickly iterate on concepts and see the results as they would look in an ARKit session.
Tracky
on your iOS device:
Files
app to navigate to the Tracky
directory, and transfer your latest recording to a computer with Blender installed:
.bren
file in Blender:
Tracky.xcodeproj
XCode Project:
Tracky outputs .bren
files with all of the recorded data from the ARKit
capture. This file can be imported into Blender via the use of the included
Blender plugin.
BrenImporter/bren_importer.py
file from this checkout:
You're all set! Now you can import your .bren
files output by the Tracky app.
https://user-images.githubusercontent.com/1228/223236400-98469d59-504d-4276-8221-45e035c031fb.mp4