This repo provides examples, guides and tools for using the Move API to access models developed by Move AI. To run these models, you will need a Move AI API key which you can request here.
The models generate spatial motion data related to humans (e.g. human motion and camera positions in different file formats) from 2D video input by using physics and AI based estimation techniques.
Most of the code examples are written in Python, although the concepts can be applied in any language.
Some examples live in their own repos and are included here as submodules.
So if you want to get all the examples, make sure to clone the repo recursively (GitHub .zip download will not include the submodules):
git clone --recurse-submodules --remote-submodules git@github.com:move-ai/recipes.git
Video game development by Electronic Arts | Music video for MGMT's “Mother Nature” by Eye Garden |
Model | Description | Inference time |
---|---|---|
singlecam | Generates spatial motion data using a single video as input, optimised for quality. | 25-30s for 10s, 60fps, HD |
singlecam-turbo (coming soon) |
Generates spatial motion data using a single video as input, optimised for speed and quality. | 10s for 10s, 60fps, HD |
multicam | Generates spatial motion data using multiple videos as input, optimised for quality. | 2.5mins for 10s, 60fps, HD, 4 cameras |
multicam-rt (available now, request access here) |
Generates spatial motion data using multiple videos as input, optimised for real-time speed. | <120ms latency |
Supports any video but best results are obtained when the camera is known
This model powers the Move One iPhone app
Track up to 5 people
This model currently only supports cameras listed here
Link | Language | Description |
---|---|---|
Move_API_single_person_single_video_unknown_camera.ipynb | Python | Generate 3D animation data of a single person from a single video from an unknown camera |
Move_API_single_person_multiple_video_go_pro.ipynb | Python | Generate 3D animation data of a single person from multiple videos from a gopro |
Move_API_JavaScript_demo | JavaScript | Generate 3D animation data of a single person from a single video from an unknown camera |
Move_API_and_retargeting_Blender_addon | Blender Python API | Move.ai API integrated into Blender via an add-on. Additional features: retargeting, scene import, rendering |
Move_API_JSON_motion_data_sample_overview.ipynb | Python | Explore and analyse the .JSON motion data output |
MoveSingleAPISwift | Swift | Swift SDK |