fabro66 / GAST-Net-3DPoseEstimation

A Graph Attention Spatio-temporal Convolutional Networks for 3D Human Pose Estimation in Video (GAST-Net)
MIT License
312 stars 70 forks source link

Plotting GAST-Net keypoints on a video #72

Open Atif-Anwer opened 3 months ago

Atif-Anwer commented 3 months ago

Not sure if the repository is actively supported, but the keypoints that are returned by GAST-net are normalized to [-1, 1] by default. If we want to plot them on a video (using only the x, y axes) we need to un-normalize them. But if I simply reverse the normalization the 3D predictions are scaled incorrectly, and furthermore the 2D skeleton retreived is not correct. Is there any readymade method to reconvert the estimated 3D keypoints back to 2D projection on top of a 2D video? Or any correct way to un-normalize the keypoints for comparison with the original input keypoints so they can be quantitatively compared?