search

cj-mills / christianjmills

My personal blog
https://christianjmills.com/
Other
2 stars 0 forks source link

Barracuda PoseNet Tutorial 2nd Edition Pt. 3 | Christian Mills #22

Open utterances-bot opened 2 years ago

utterances-bot commented 2 years ago

Barracuda PoseNet Tutorial 2nd Edition Pt. 3 | Christian Mills

This post covers how to implement the preprocessing steps for the PoseNet models.

https://christianjmills.com/Barracuda-PoseNet-Tutorial-V2-3/

Aspeers1 commented 2 years ago

Hey CJ, Firstly this tutorial is amazing an a wonderful resource for learning about pose estimation. I was kind hoping I could persuade you to do an extra bit on mapping the pose skeleton to an avatar like Unity Kyle. It'd be amazing to see a character dance using the pose data!

cj-mills commented 2 years ago

Hi @Aspeers1, I'm glad you like the tutorial!

One of my future tutorial plans involves demonstrating how to generate synthetic training data for a 3D pose-estimation model using an application like Blender, Unity, or Unreal Engine, training the model, and mapping input from a standard webcam to a virtual character.

It might be a bit before I can start working on that.

I am working with Intel on the initial version of an AIGamedevToolkit project. The idea for the project is to lower the barriers to adding deep learning functionality to Unity projects. Ideally, there will be a version for Unreal Engine as well.

That is why I have not posted any new tutorials in a while.

Currently, I consider the project to be a proof of concept. However, it is functional if you want to check it out.

I am waiting to see if Intel is willing to commit the resources needed to realize the vision for the project. If you think a tool like this would be interesting, be sure to let them know.

I will post here to let you know when I can start working on the new pose estimation tutorial.