search

microsoft / multiview-human-pose-estimation-pytorch

This is an official Pytorch implementation of "Cross View Fusion for 3D Human Pose Estimation, ICCV 2019".
MIT License
541 stars 89 forks source link

How do you created the warped heatmap? #35

Open wwang107 opened 3 years ago

wwang107 commented 3 years ago

Hi,

I am very interested in the code that creates a warped heatmap. However, I can not find it in the repo, can you point out where is it?

haibo-qiu commented 3 years ago

Suppose we have four views images for training.

If we randomly choose a certain view as the primary view, then the warped heatmap is obtained by weighted addition of the heatmaps mapped (using the fc layer) from the other three views.

Please refer to this link for the details of fusion.

poincarelee commented 9 months ago

@haibo-qiu hi, the weights [0.4,0.2,0.2,0.2] was learned through models or set by hand?

haibo-qiu commented 9 months ago

Hi @poincarelee, the weights [0.4, 0.2, 0.2, 0.2] is handcrafted by using a simple strategy: the primary view should be dominant while the other views hold an equal position.

poincarelee commented 9 months ago

@haibo-qiu okay, Thanks a lot.