Roadmap of MMPose

[hellock]

We keep this issue open to collect feature requests from users and hear your voice. Our monthly release plan is also available here.

You can either:

1. Suggest a new feature by leaving a comment.
2. Vote for a feature request with 👍 or be against with 👎. (Remember that developers are busy and cannot respond to all feature requests, so vote for your most favorable one!)
3. Tell us that you would like to help implement one of the features in the list or review the PRs. (This is the greatest things to hear about!)

[jin-s13]

Support 3dpw dataset #682

[aqsc]

Do you have any plans for the mano based hand keypoints detection? Also optimization with the IK loss

[AmitMY]

Add 3D Pose Consistency Benchmark - https://github.com/open-mmlab/mmpose/issues/828

[znoland3]

Add https://github.com/mks0601/3DMPPE_POSENET_RELEASE into MMPose

[Broken1334]

It would be nice to add "PoseFormer". It based on VideoPose3D, which already supported.

[ee-lynn]

It would be nice to add "CenterNet". it is a bottom up based 2d human pose estimation method and it groups keypoints of one person by combine regression and heatmap of keypoints which is quite different from associated embedding and affinity fields

[APeiZou]

Blog:Next-Generation Pose Detection with MoveNet and TensorFlow.js 这里有movenet的简单介绍，https://storage.googleapis.com/movenet/MoveNet.SinglePose%20Model%20Card.pdf

[canghaiyunfan]

Add RLE into MMPose

[francescotaioli]

Background : 3d pose estimation (with video generation) with a high number of people (es: official video, minute 00:19 sec, but with a lot of people

Result video: the original video is put on the top-left, with the subsuquent 3d pose of the people on the right. If there are a lot of people, the final video has strange resolution (i.e 6000x400) because every people detected is on put on the same row.

What could be improve: split the people 3d pose visualization into multiple row

[piercus]

It would be great to have a 'score_per_joint' option in test_cfg in order to output one score per joint, instead of having only a global score for the pose, my use case is related to associative embedding

[liwenssss]

update Interhand2.6M dataset which contains MANO hand mesh parameters.......

[walsvid]

It would be nice to have Depth-Based 3D Hand Pose Estimation methods like A2J.

[vra]

It would be great to have SmoothNet trained on 3DPW and AIST++ :)

[qinb]

It would be nice to add SmoothNet training code about pose estimation, hoping it could easily retrain on my own dataset.

[Joyako]

3D Human Mesh frankmocap

[ly015]

3D Human Mesh frankmocap

Thanks for your feedback. 3D human mesh recovery is no longer supported in MMPose. We have MMHuman3D for this task and you are welcome to submit an issue there about your request.

[yshMars]

It would be so helpful for better analysis if AP for each type of body joints are printed, for example 17 AP value for 17 kinds of body joints are given when inferencing a model in MS COCO body-keypoint dataset.

[levan92]

Will be really helpful to implement MIPNet into mmpose:

• It is particularly useful to tackle data where there are crowded/highly occluded humans. Was previously the SOTA on OCHuman before ViTPose came along. Within the realms of convnets, it should still be the SOTA, and it seems like the idea is general enough to be applied to different types of backbones.

[levan92]

Also similar to #1389 request, will be nice to integrate ViTPose into mmpose. ViTPose is already implemented in mmpose, so I expect integration to be much easier 😄

[jin-s13]

It would be so helpful for better analysis if AP for each type of body joints are printed, for example 17 AP value for 17 kinds of body joints are given when inferencing a model in MS COCO body-keypoint dataset.

@yshMars Already supported in https://github.com/open-mmlab/mmpose/pull/1170

[liuzhuang13]

It would be nice to support ConvNeXt backbones. It is a very simple model that is purely convolutional. They can serve as a drop-in replacement for ResNet or Swin Transformer architectures. ImageNet-22k pretrained ConvNeXt variants are considered state-of-the-art in this regime.

Official code: https://github.com/facebookresearch/ConvNeXt ConvNeXt was also implemented in the mmsegmentation and mmdetection libraries.

Thanks!

[darcula1993]

It would be nice to have Poseaug augmentation pipeline for 3d pose estimation. official code: [(https://github.com/jfzhang95/PoseAug)]

Thanks!

[AshvantSelvam]

Would like to have Tracing support for mmPose models. I have been able to successfully use 'torch2torchscript' under mmdeploy.apis to trace mmSegmentation Models. However, using the same on mmPose (triedconfigs under dekr and associative_embedding) with the following mmdeploy config: '\mmdeploy\configs\mmpose\pose-detection_torchscript.py' would throw the following error:

File "mmdetection\mmpose\mmpose\datasets\pipelines\shared_transform.py", line 176, in call meta[key_tgt] = results[key_src]

KeyError: 'flip_index'

Would really appreciate having this feature! Thanks

[qwert31639]

Can SCRFD be added to mmpose? https://github.com/deepinsight/insightface/tree/master/detection/scrfd

[jin-s13]

Can SCRFD be added to mmpose? https://github.com/deepinsight/insightface/tree/master/detection/scrfd

It seems that SCRFD is for face detection. MMPose will focus on pose estimation/keypoint detection. Maybe it is more appropriate to support it in mmdet.

[BobDLA]

Are you still woking on the openpose which has list on the ROADMAP for years?

Thanks