search

creativeIKEP / BlazePoseBarracuda

BlazePoseBarracuda is a human 2D/3D pose estimation neural network that runs the Mediapipe Pose (BlazePose) pipeline on the Unity Barracuda with GPU.
Apache License 2.0
199 stars 31 forks source link
barracuda deep-learning human-pose-estimation mediapipe neural-network pose unity

readme

BlazePoseBarracuda

BlazePoseBarracuda is a human 2D/3D pose estimation neural network that works with a monocular color camera.

BlazePoseBarracuda is Unity Package that runs the Mediapipe Pose(BlazePose) pipeline on the Unity.

BlazePoseBarracuda implementation is inspired by HandPoseBarracuda and I referenced his source code.(Thanks, keijiro!).

Dependencies

BlazePoseBarracuda uses the following sub packages:

Install

BlazePoseBarracuda can be installed from npm or GitHub URL.

Install from npm (Recommend)

BlazePoseBarracuda can be installed by adding following sections to the manifest file (Packages/manifest.json).

To the scopedRegistries section:

{
  "name": "creativeikep",
  "url": "https://registry.npmjs.com",
  "scopes": [ "jp.ikep" ]
}

To the dependencies section:

"jp.ikep.mediapipe.blazepose": "1.3.0"

Finally, the manifest file looks like below:

{
    "scopedRegistries": [
        {
            "name": "creativeikep",
            "url": "https://registry.npmjs.com",
            "scopes": [ "jp.ikep" ]
        }
    ],
    "dependencies": {
        "jp.ikep.mediapipe.blazepose": "1.3.0",
        ...
    }
}

Install from GitHub URL

BlazePoseBarracuda can be installed by adding below URLs from the Unity Package Manager's window

https://github.com/creativeIKEP/PoseDetectionBarracuda.git?path=Packages/PoseDetectionBarracuda#v1.0.1
https://github.com/creativeIKEP/PoseLandmarkBarracuda.git?path=Packages/PoseLandmarkBarracuda#v1.1.1
https://github.com/creativeIKEP/BlazePoseBarracuda.git?path=Packages/BlazePoseBarracuda#v1.3.0

or, appending lines to your manifest file(Packages/manifest.json) dependencies block. Example is below.

{
  "dependencies": {
    "jp.ikep.mediapipe.posedetection": "https://github.com/creativeIKEP/PoseDetectionBarracuda.git?path=Packages/PoseDetectionBarracuda#v1.0.1",
    "jp.ikep.mediapipe.poselandmark": "https://github.com/creativeIKEP/PoseLandmarkBarracuda.git?path=Packages/PoseLandmarkBarracuda#v1.1.1",
    "jp.ikep.mediapipe.blazepose": "https://github.com/creativeIKEP/BlazePoseBarracuda.git?path=Packages/BlazePoseBarracuda#v1.3.0",
    ...
  }
}

Usage Demo

This repository has the demo for inferencing pose and visualizing landmarks. Check "/Assets/Script/PoseVisuallizer.cs" and "/Assets/Scenes/2DSampleScene.unity" for BlazePoseBarracuda usage demo details in the 2D pose estimation. Check "/Assets/Script/PoseVisuallizer3D.cs" and "/Assets/Scenes/3DSampleScene.unity" for BlazePoseBarracuda usage demo details in the 3D pose estimation.

Demo Image

Videos for demo scenes("/Assets/Scenes/2DSampleScene.unity" and "/Assets/Scenes/3DSampleScene.unity") was downloaded from pexels.

Author

IKEP

LICENSE

Copyright (c) 2021 IKEP

Apache-2.0