cj-mills / onnx-directml-unity-tutorial

This tutorial covers creating an object detection plugin for a Unity game engine project using ONNX Runtime and DirectML.
https://christianjmills.com/posts/onnx-directml-unity-tutorial/part-1/
MIT License
16 stars 1 forks source link
directml object-detection onnxruntime tutorial unity yolox

ONNX Runtime → DirectML → Unity → Tutorial

Tutorial Links

Demo Video

https://user-images.githubusercontent.com/9126128/185470552-bd485f66-5181-4767-b5c4-4e38d04d896d.mp4

Training Code

Jupyter Notebook Colab         Kaggle        
GitHub Repository Open In Colab Kaggle

Note: Training on the free GPU tier for Google Colab takes approximately 11 minutes per epoch, while training on the free GPU tier for Kaggle Notebooks takes around 15 minutes per epoch.

Kaggle Datasets

Reference Images


| Class | Image | | --------- | ------------------------------------------------------------ | | call | ![call](./images/call.jpg) | | dislike | ![dislike](./images/dislike.jpg) | | fist | ![ fist](./images/fist.jpg) | | four | ![four](./images/four.jpg) | | like | ![ like](./images/like.jpg) | | mute | ![ mute](./images/mute.jpg) | | ok | ![ ok](./images/ok.jpg) | | one | ![ one](./images/one.jpg) | | palm | ![ palm](./images/palm.jpg) | | peace | ![peace](./images/peace.jpg) | | peace_inverted | ![peace_inverted](./images/peace_inverted.jpg) | | rock | ![rock](./images/rock.jpg) | | stop | ![stop](./images/stop.jpg) | | stop_inverted | ![stop_inverted](./images/stop_inverted.jpg) | | three | ![three](./images/three.jpg) | | three2 | ![three2](./images/three2.jpg) | | two_up | ![ two_up](./images/two_up.jpg) | | two_up_inverted | ![two_up_inverted](./images/two_up_inverted.jpg) |