search

keijiro / BodyPixSentis

BodyPix for Unity Sentis
Apache License 2.0
188 stars 29 forks source link

readme

BodyPixSentis

gif gif

BodyPixSentis is an implementation of the BodyPix person segmentation and pose estimation model that runs on the Unity Sentis neural network inference library.

System requirements

About the ONNX file

I converted the original BodyPix model (provided as tfjs) into ONNX using tfjs-to-tf and tf2onnx. See [the Colab notebook] for further details.

[the Colab notebook]: https://colab.research.google.com/drive/1ikOMoqOX7TSBNId0lGaQ_kIyDF2GV3M3?usp=sharing

ResNet support

This package supports the ResNet architecture (more accurate but slower and bigger models) but doesn't contain those ONNX files due to the file size limit of GitHub and npm.js. You can download them from [here][ResNetZip] instead.

To use those models, create a new BodyPix ResourceSet file and set the model, architecture, and stride fields accordingly.

ResNet50

[ResNetZip]: https://github.com/keijiro/BodyPixSentis/releases/download/1.0.3/ResNet50Models.zip

How to install

This package uses the scoped registry feature to resolve package dependencies. Open the Package Manager page in the Project Settings window and add the following entry to the Scoped Registries list:

Scoped Registry

Now you can install the package from My Registries page in the Package Manager window.

My Registries