search

federicocunico / human-robot-collaboration

Utilities for visualizing the human poses of CHICO dataset from "Pose Forecasting in Industrial Human-Robot Collaboration" ECCV 2022 paper.
11 stars 2 forks source link

Camera calibration issue #1

Open isarandi opened 1 year ago

isarandi commented 1 year ago

Hi,

Thanks for this work, it's very interesting (I saw your poster at ECCV). I've downloaded the dataset, but the camera calibration seems to be off when I try to visualize poses projected onto the video frames. For example, for the sequence S00_hammer, I get these:

chico_03 chico_06 chico_12

Do you know of any issue that may cause this problem?

federicocunico commented 1 year ago

I don't know exactly why there is this misalignment. I know the camera parameters were calculated with the checkboard you see in the images, so they should be correctly estimated. Also, the 3D keypoints are consistent in the 3D space. Note that the parameters have been used with Voxelpose to make the annotations, maybe inside the Voxelpose script, there is some preprocessing or postprocessing on the data or on the parameters. You should start investigating from their source code to understand the possible processing that has been performed to understand this error. If you just need the 3D poses for forecasting or action recognition, camera parameters should not be mandatory.