studiolanes / vision-utils

Scripts to convert 2D images and videos into Spatial versions
https://blog.studiolanes.com/spatial
MIT License
81 stars 7 forks source link
depth-anything spatial spatial-computing spatial-photo spatial-video vision-pro visionos
 __   _(_)___(_) ___  _ __    _   _| |_(_) |___
 \ \ / / / __| |/ _ \| '_ \  | | | | __| | / __|
  \ V /| \__ \ | (_) | | | | | |_| | |_| | \__ \
   \_/ |_|___/_|\___/|_| |_|  \__,_|\__|_|_|___/

vision-utils

This repo contains various projects related to the Vision Pro & visionOS.

Content

2D to Spatial Content

Convert any photos to spatial photos and videos viewable in the Apple Vision Pro! There is a mini swift cli executable that works on M1 apple computers to attach png files together.

See Photo Blog Post and Video Blog Post for more info.

Dependencies

We borrow the executable and iPhone args from Mike Swanson for converting over under videos to spatial videos.

We assume that you have poetry globally installed for python packaging and you're using Python 3.

cd spatialconverter
poetry install
poetry shell
# Poetry breaks when trying to install transformers from source, so run this installation the first time
pip install -q git+https://github.com/huggingface/transformers.git

Subsequent runs

cd spatialconverter/spatialconverter
poetry shell
python main.py --photo /Users/herk/Downloads/photo.png
# python main.py --video /Users/herk/Downloads/skydive.mp4