search

open-mmlab / mmpose

OpenMMLab Pose Estimation Toolbox and Benchmark.
https://mmpose.readthedocs.io/en/latest/
Apache License 2.0
5.55k stars 1.21k forks source link

Integration of state of the art pose estimation: ViTPose. #1389

Open khanhha opened 2 years ago

khanhha commented 2 years ago

Hi awesome developers from MMPose. A new state of the art pose estimation research has published their code. https://github.com/ViTAE-Transformer/ViTPose MMPose is the leading open-source project in this field, so I am really looking forward for an integration of this research into MMPose. Thanks

liqikai9 commented 2 years ago

Thanks for your interest in MMPose and your suggestion. We will look into it. You can also comment on the roadmap of MMPose here.

Annbless commented 2 years ago

Hi@khanhha, Thanks for your interest in ViTPose.

Hi, awesome developers from MMPose. Thanks for your fantastic work in MMPose. The framework is wonderful and helps greatly in our ViTPose and other pose works!

We are willing to integrate ViTPose into MMPose and contribute to the community. Most of the modifications exist in the backbone folder (i.e., register a new backbone) and the head (i.e., support a simpler decoder and add a parameter for control) file. A new optimizer constructor is also utilized in the mmcv_custom folder to support layer-wise learning rate decay for training.

If there is anything that we could help with, please do not hesitate to contact us.

ly015 commented 2 years ago

@Annbless Thank you very much for your help! It's inspiring to see that MMPose is facilitating great research works like ViTPose and bringing convenience to the community. And the contribution from the community is very much appreciated. We are looking forward to your PRs to integrate ViTPose into MMPose. Please let us know if there is anything we can help with.