augmented reality - is it possible with this library?

[Marcus5234]

→ Step 1: Describe the issue

I'd like to make an augmented reality experience based on image tracking. How can I achieve this with ml5, if possible?

→ Step 2: Screenshots or Relevant Documentation

Here's some helpful screenshots and/or documentation of the new feature Image Recognition/Tracking

→ Step 3: Share an example of the issue

Please see ARJS, it has marker based AR but not image tracking. I want something like Vuforia.

[joeyklee]

Dear @Marcus5234

The short answer is:

• Yes, making AR applications in the browser is possible.
• Some combination of using the ml5 YOLO function (or the ml5 object detector - coming soon) and some p5.js or visualization that draws where your objects of interest are on the frame would be the way to do it. Depending on the objects you're trying to track you could also use poseNet for tracking body parts.

As for specific implementation tips, I'd highly recommend looking at the examples in https://ml5js.github.io/ml5-examples/public/ or based on the documentation the https://ml5js.org.

I hope this helps!

You're welcome to continue the commentary, but as this issue is not directly related to the library as a feature request/bug/discussion, I will close this issue for now. Thanks!