search

googlesamples / mlkit

A collection of sample apps to demonstrate how to use Google's ML Kit APIs on Android and iOS
Apache License 2.0
3.61k stars 2.94k forks source link

Where is the pose detection model? #455

Closed blackCmd closed 2 years ago

blackCmd commented 2 years ago

I opened an Android sample app.(https://github.com/googlesamples/mlkit/tree/master/android/vision-quickstart)

But there is no modmodel related to pose detection in the assets directory.

Where is the pose detectionel related to pose detection in the assets directory.

Where is the pose detection model?

ai-plays commented 2 years ago

The model is in the SDK('com.google.mlkit:pose-detection:18.0.0-beta2') instead of in the sample app.

We only open-source the sample app, but not the SDK.

blackCmd commented 2 years ago

The model is in the SDK('com.google.mlkit:pose-detection:18.0.0-beta2') instead of in the sample app.

We only open-source the sample app, but not the SDK.

@steven-chengji-yan Thanks for reply. Then Can I ask the model's name? Is it BlazePose?

ai-plays commented 2 years ago

No problem.

Yes, it is one version of BlazePose.

blackCmd commented 2 years ago

No problem.

Yes, it is one version of BlazePose.

Thank you : ) I hope to support customization of the model and detect multiple poses in the future.

ai-plays commented 2 years ago

For multi-person pose detection, once BlazePose support it, ML Kit will evaluate and consider to integrate.

As for customization, could you elaborate a bit more about what custom behavior you are looking for? Only detect certain poses while ignoring other poses?

There are two models in the Pose pipeline at the moment (some context): the first model detect where the person is, the second model detect the body landmarks. Which step do you want to customize? Also, what's your plan for getting the customized models? Are there any existing tools for training customized pose detection models you are thinking about?