search

jfzhang95 / PoseAug

[CVPR 2021] PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation, (Oral, Best Paper Award Finalist)
MIT License
366 stars 57 forks source link

Is PoseAug able to produce some special poses while doing the augmentation? #32

Closed AndyVerne closed 2 years ago

AndyVerne commented 2 years ago

Hi, thanks so much for your great job. I learn a lot from this project.

I learned that your code indicates "that fix bone segment from pelvis to thorax to avoid pure rotation of whole body without ba changes."

So at the mean time, according to this condition that fix the bone segment from pelvis to thorax, I am curious about the PoseAug whether can produce some special types of poses like "lying down" , "push ups" and so on.

I'm looking forward to your replies.

Garfield-kh commented 2 years ago

Hi, thank you for the interest! To control the augmentation process for producing special types of poses like "lying down", there are several approaches that may help.

  1. If you have a 2D pose dataset D2 containing "lying down", replace the target_2d_loader by D2 so that the model_d2dcan learn from such data and guide the augmentor.
  2. Similarly, if you have a 3D pose dataset D3 containing "lying down", replace the target_3d_loaderby D3 so that the model_d3dcan learn from such data and guide the augmentor.
  3. You may also considering action conditioned pose generation (i.e. Conditional GAN) if you have the pose data with labels as conditional input.

Hope this helps. Thank you~

AndyVerne commented 2 years ago

Thanks for your replies! It does a lot help to me! Hope you have a great day :)