FabianPlum / OmniTrax

Deep learning-driven multi animal tracking and pose estimation add-on for Blender
MIT License
29 stars 4 forks source link

human body tracking #1

Closed ekswathi closed 1 year ago

ekswathi commented 1 year ago

Is there any trained model for human body tracking?

FabianPlum commented 1 year ago

Are you looking for a tracking solution for individual body parts, i.e. human pose estimation, or tracking the position of multiple humans in an image (like in the top down video examples showing the ants moving through frame)?

ekswathi commented 1 year ago

face mainly from captured video

FabianPlum commented 1 year ago

That's a little more difficult with the current pipeline, but I'm planning on improving the pose estimation pipeline in the near future to include such options.

This will however never be a full motion capture pipeline for human pose estimation and / or facial mocap for character animation specifically. Perhaps check out this approach: https://blender.community/c/today/pQ5X/?sorting=hot

All the best Fabi