search

sebastianstarke / AI4Animation

Bringing Characters to Life with Computer Brains in Unity
7.9k stars 1.06k forks source link

Siggraph Asia 2019 Motion Data Processing #90

Open walkerwjt opened 2 years ago

walkerwjt commented 2 years ago

Hi Sebastian,

Thank you for posting this amazing work!

I am trying to reproduce the results from scratch (the raw .bvh files -> asset data -> input.txt/output.txt for training). But the results I reproduced have some problems：

1) The agent cannot turn left or right when running, I mean when I press Shift+W+E/Q at the same time, the action of agent will crash; 2) The posture of the agent is unnatural when sitting down, and there is always an offset from the marked contacts point; And when I directly export your data as training data pressing Export Data button in MotionExporter, the results don't have these problems.

This is my data processing: 1) Use BVH Importer to import .bvh files which comes from MotionCapture.zip. When importing some .bvh files, the Flip option is checked, such as Jump, RunTurn, WalkTurn etc.. The data is saved in Assets/MotionCapture_reproduce/; 2) Copy the .unity files in Assets/MotionCapture/ and overwrite the .unity files in Assets/MotionCapture_reproduce/. I found that many actions need to create objects by myself, such as Amchair, Avoid, Sit etc., which would be time-consuming to do manually, so I directly copied them; 3) Click the Import option in the figure below, and in the 'public void Import()' in MotionEditor.cs, I added the following code to import the Modules, Sequences, Export, Framerate, MirrorAxis, and Offset parameters from Assets/MotionCapture/ and copied to the data in Assets/MotionCapture_reproduce/; 4) Use the MotionExporter in the unity scene to export my own data; image

At the same time, I also noticed that the data in Assets/MotionCapture/ is far more than the .bvh files from MotionCapture.zip, but I don't know how the extra data came from, so I only used the data in MotionCapture.zip to reproduce the results;

So, is my data processing missing something? Or which step is wrong? Where does the extra data in Assets/MotionCapture/ come from? Can you elaborate your data processing from the raw .bvh files to asset data?

Need your help. Thanks a lot!

guo787269125 commented 1 year ago

We are facing the same problem, and have no idear about this.