StandardCyborg / StandardCyborgCocoa

Everything you need for 3D scanning on iOS
https://www.standardcyborg.com
Other
143 stars 49 forks source link

How to get the Facial Landmarks? #37

Closed kushJadia closed 10 months ago

kushJadia commented 11 months ago

I have used the below method to show the Preview of the scanned data.

let vc = ScenePreviewViewController(pointCloud: pointCloud, meshTexturing: controller.meshTexturing, landmarks: nil)

In this method how can I get or Pass the Landmarks?

kushJadia commented 10 months ago

Does anyone have any idea about how to get the facial landmarks data using this SDK?

aaptho commented 10 months ago

Hello, this SDK does not provide any face landmarking capabilities.

You can use the Vision framework for calculating 2D face landmarks from an RGB video frame.

PBFModel does have support for putting 2D screen-space landmarks onto the 3D model, but it’s not hooked up to anything. If anyone wants to build this support, they are welcome to submit a PR.