StandardCyborg / StandardCyborgSDK

A C++ SDK for 3D computer vision, paired with Cocoa frameworks for TrueDepth-based 3D scanning, meshing, and ML landmarking models + analysis for foot and ear
MIT License
46 stars 25 forks source link

Landmarks on 3D model after scanning. #13

Closed MorozPavlo closed 10 months ago

MorozPavlo commented 1 year ago

As I understand, the current SDK lacks the necessary files or models for 3D point detection on a 3D model. Can you please clarify how it is possible to place points on a 3D model using only 2D coordinates?

Are there any ways to obtain the missing files?

aaptho commented 1 year ago

There are no missing files to speak of.

The landmarking actually works on RGB frames in 2D. But you can un-project back into 3D to place the 2D landmarks on the 3D point cloud.

It’s been ages since I’ve used this, so my memory is foggy and there are no examples, and it might not even work anymore, but check out OfflineSurfelLandmarking