nv-tlabs / ASE

Other
788 stars 125 forks source link

Retargeted animation looks really weird (upperArm position)... Is that normal? #63

Open nicolasfischoeder opened 1 year ago

nicolasfischoeder commented 1 year ago

Hello everybody,

I am attempting to retarget one of my own animations onto AMP via the provided scripts. However, I notice that the upper arm/shoulder positions look very off compared to my t-Pose and original animation. Basically they have the same height as the highest point in my skeleton, which I assume to be the head-bone.

Screenshots:

  1. Retargeted animation
  2. My rig t-pose in the fbx-importer
  3. My animation in the fbx-importer

Screenshot from 2023-09-29 16-02-20 Screenshot from 2023-09-29 16-06-21 Screenshot from 2023-09-29 16-07-11

What strikes me the most is, that the retargeting from the CMU examples produces the identical behavior!

@xbpeng Can you please comment on that? What is the deal here? Can you maybe provide a screenshot of the reallusion retargeting? What would you recommend?

xbpeng commented 1 year ago

hard to tell what's going on here. It almost seems like the retargeted results are completely ignore the pose in the source data? You'll probably need to dig into this a bit to see what might be going wrong.

YandongJi commented 1 year ago

Having the same issue, seems like when the two architectures are too different, the skeleton will also change

hhebb commented 1 year ago

i have encountered same issue.

one possible solution that i am using.

  1. retarget your motion -> cmu t-pose
  2. retarget cmu motion -> amp t-pose (as introduced in motion_lib example)

i successfully using my motion using this mehod.

good luck