search

Xinyu-Yi / TransPose

A real-time motion capture system that estimates poses and global translations using only 6 inertial measurement units
https://xinyu-yi.github.io/TransPose/
GNU General Public License v3.0
373 stars 72 forks source link

Is there a bug in evaluation script? #61

Closed syguan96 closed 3 months ago

syguan96 commented 9 months ago

When evaluating Transpose on DIP, you evaluate the mean error on each sequence and then average them. However, the sequence length is not equal, so you should save the errors of each sample and calculate the mean error on the whole dataset. Am I right?

syguan96 commented 9 months ago

Update: For Jitter, we should calculate on each sequence separately. For other metrics, we should calculate on the whole dataset.

Xinyu-Yi commented 9 months ago

When evaluating Transpose on DIP, you evaluate the mean error on each sequence and then average them. However, the sequence length is not equal, so you should save the errors of each sample and calculate the mean error on the whole dataset. Am I right?

Yes. The results in the paper can be reproduced using the current evaluation method. But definitely you can use the new averaging method.