search

chili-epfl / chilitrack

A marker-less tracking library for augmented reality (heavily relying on OpenCV)
15 stars 10 forks source link

3D tracking #6

Open ayberkozgur opened 9 years ago

ayberkozgur commented 9 years ago

Just throwing an idea out there that can be implemented in the future: We can try to track non-flat objects that has features all over. Here's very roughly how we would do it:

  1. Read in object's model and texture (assimp could help here)
  2. All flat faces are treated as different templates and are detected/tracked in the image
  3. Since we know the face poses and therefore feature positions wrt the object frame, we can PNP over all that are detected

This would just be like multitag Chilitags. Of course, we should not triangulate the whole object and try to detect 10K triangles. Instead, we should take large flat areas and possibly discard featureless or curved areas. Moreover, we could design objects that could be recognized by this procedure easily.

severin-lemaignan commented 9 years ago

Yes, I had a similar idea, yet a bit simpler: just allowing users to submit a config file with a list of images path + a set of 3D coordinates for the corners of these images. But using assimp could be a cool idea.