tucan9389 / PoseEstimation-CoreML

The example project of inferencing Pose Estimation using Core ML
https://github.com/motlabs/awesome-ml-demos-with-ios
MIT License
680 stars 136 forks source link

Hourglass model #1

Closed edvardHua closed 4 years ago

edvardHua commented 6 years ago

Try to use hourglass model in here.

I think it will speed up 3x than old model and the precision is acceptable.

Tomorrow I will update my repo.

Look forward to your replay ( ? FPS on ipx )

tucan9389 commented 6 years ago

@edvardHua AWESOME! I'll try that model ๐Ÿ‘ Do you have a python script that converts to Core ML model? I have some issue in step converting to Core ML with my own model now ๐Ÿ˜“

edvardHua commented 6 years ago

Yes, I will let you know when I update repo tomorrow.

tucan9389 commented 6 years ago

@edvardHua I capture video comparing two models. but It's little weird for accuracy.

model cpm model hourglass model
inference time 57(45~70)mm 33(30~35)mm
accuracy more accurate(0.9) less accurate(<0.5)
DEMO video poseestimation-coreml-cpm poseestimation-coreml-hourglass
edvardHua commented 6 years ago

Indeed, the old one precision is higher than the new one.

PCKh of cpm model is 94.18.
PCKh of hourglass model is 91.

But hourglass do not have too wide difference on android device.

You can test android demo here

edvardHua commented 6 years ago

@tucan9389 Here is the script I used to convert mlmodel.

tucan9389 commented 6 years ago

Thanks a lot

BroderickHigby commented 5 years ago

Hey Tucan, Would you mind uploading your mv2_cpm_model_98000 mlmodel? I'm interested in seeing its model accuracy compared to the previous accuracy.

tucan9389 commented 5 years ago

@BroderickHigby Unfortunately I canโ€™t open my models. If you want compare between cpm and hourglass model, you can download from here.

tucan9389 commented 4 years ago

Close the issue now. You can reopen when you want. @edvardHua