search

hpssjellis / tensorflowjs-bvh

This is a guess that posenet and bvh were meant to be together
https://hpssjellis.github.io/tensorflowjs-bvh/
Apache License 2.0
7 stars 0 forks source link

Points to BVH angles #1

Open tin2tin opened 6 years ago

tin2tin commented 6 years ago

This is not really an issue, more like an encouragement. PoseNet to BVH is a brilliant idea. Just imagine being able to convert human motion from classic silent films to 3D animation. I can understand that you have met a dead end on converting the PoseNet points to BVH angles? Have you been through the various bvh js parsing scripts here on github: https://www.google.com/search?q=site:github.com+bvh+parser+js&ei=ucx_W8CaEIPF6ASjuSc&start=10&sa=N&biw=1600&bih=752

Something like this pops up: https://github.com/omimo/PyMO but maybe it is parsing from angles to points?

I know that has been work on getting Kinect to BVH for use in Blender, maybe something might pop up if you search in that direction? Like this: https://github.com/meshonline/kinect-openni-bvh-saver

Anyway I'm not a coder, but I can definitely see possibilities, as mentioned above. Imagine to posedetect the world's first comedy film: https://www.youtube.com/watch?v=IooPPi1YzkM and convert it into a 3D animation - or Buster Keaton films...

hpssjellis commented 6 years ago

Thanks for the encouragement @tin2tin I have to put this on the back-burner for a bit while I work on my Tensorflowjs Tutorials but will continue working on it later.

Looks like someone just tweeted something along the same lines here I can't tell if the GAN network is using BVH values or just generating the results directly from the neural network.

tin2tin commented 6 years ago

Just one more finding, which seems to export to bvh: https://github.com/CMU-Perceptual-Computing-Lab/openpose