search

open-mmlab / mmpose

OpenMMLab Pose Estimation Toolbox and Benchmark.
https://mmpose.readthedocs.io/en/latest/
Apache License 2.0
5.55k stars 1.21k forks source link

Custom Object Keypoint detector #1418

Open nath-partha opened 2 years ago

nath-partha commented 2 years ago

I am looking to implement a keypoint detetctor with a custom dataset. The setup for hand or full body keypoint detection or retraining is understanadble from the documentation. Is there any similar setup for object keypoint detectors. I have been going through the papers and techniques included in mmpose but have not come across one yet.

ly015 commented 2 years ago

Thanks for using MMPose. By 'object keypoint detector` do you mean models to detect keypoints of objects like vehicles? I think the general steps should be similar to those of tasks like human body keypoints or hand keypoints. Are there any specific problems that we can help with?

nath-partha commented 2 years ago

Smaller handheld objects, but yes similar principle. I am trying to finetune pretrained models to avoid training from scratch and my query was does any of the papers or datasets in mpose release such a model?

But I have mostly finished going through the papers in the readthedocs and haven't found one pretrained for objects yet. Let me know if Im way off course here and yes this was more of general question about the model zoo. You may close the issue after this.

ly015 commented 2 years ago

I am afraid that there is no pre-trained model in MMPose Model Zoo that meets your need. So far we have models for the human body, animals, and clothes (fashion keypoint), but not for rigid objects like handheld devices.

BTW, if you are interested in making your work open source in the future, it would be very much appreciated if you would like to create a PR in MMPose. Supporting pose estimation of rigid objects will be a major enhancement of MMPose and definitely benefit the community.