Superlee506 / Mask_RCNN_Humanpose

Mask R-CNN for Human Pose Estimation on Keras and TensorFlow.
Other
189 stars 36 forks source link

Unable to converge on keypoint #25

Closed chenzeyuczy closed 6 years ago

chenzeyuczy commented 6 years ago

Hey @Superlee506 . It's a nice job for you to modify the project for keypoint detection. I've use your codes for face landmark detections, which outputs less keypoints than the human pose. However, it is tough for me to makes the output converge. The keypoint loss gets stable at about 2.8 or so while the 4 other losses for ROI detection is lower than 0.3. The keypoint detection is not accurate during the test phase. I wonder whether you can reproduce the result from the original paper and that I'm curious about the curve for keypoint mask loss.

Superlee506 commented 6 years ago

Thanks for your interest, you can refer to Caffe2 for reproduction, I also wonder about the results in MaskCNN, because the model often can't distinguish the symmetrical keypoints. While in the densepose , they make use of cascade network to achieve better performance, you can refer to the newest work.