karfly / learnable-triangulation-pytorch

This repository is an official PyTorch implementation of the paper "Learnable Triangulation of Human Pose" (ICCV 2019, oral). Proposed method archives state-of-the-art results in multi-view 3D human pose estimation!
MIT License
1.09k stars 181 forks source link

2D backbone pretraining details #128

Open Deng-Y opened 3 years ago

Deng-Y commented 3 years ago

Hello,

May I ask for more details regarding 2D backbone pretraining? Quoted from the paper:

The 2D backbone for Human3.6M was pretrained on the COCO dataset [10] and finetuned jointly on MPII and Human3.6M for 10 epochs using the Adam optimizer with 10^−4 learning rate.

I have the following questions:

  1. What loss function do you use in pretraining?
  2. The setting "for 10 epochs using the Adam optimizer with 10^−4 learning rate" seems only to apply to the fine-tuning on MPII and Human3.6M, then what's the setting for the COCO dataset?
  3. Can you provide the pretraining code or recommend a GitHub repository for pretraining?

I found that pretraining is very important. I trained the volumetric model without loading pretrained weights of the 2D backbone, and the relative MPJPE increase drastically from ~20 to ~30. Thus, 2D backbone pertaining is quite necessary.

Look forward to hearing from you. Thank you!