search

google-ar / arcore-unity-sdk

ARCore SDK for Unity
https://developers.google.com/ar
Other
1.4k stars 402 forks source link

Request for tracking moving augmented images #299

Open ChristophGeske opened 6 years ago

ChristophGeske commented 6 years ago

I know it is not supported at the moment therefore this request. Tracking of moving markers works on ARKit2 (see here: https://www.youtube.com/watch?v=ySYFZwkZoio) and I would love to have that feature on ARCore too. I tried to do it with Augmented Images but the results are not that great. It works kind of but with huge lag. Is there a workaround to make it work better? Would destroying and reloading the Augmented Image Controller a few times a second work to get at least a low fps marker tracking to run?

If the feature points that belong to the detected marker are not beeing used to for the orientation in the room that would be nice as well otherwhise the marker could move the ARCore Camera around.

pablisho commented 6 years ago

Hi, thanks for the feature request. The thing that can improve detection speed is setting the physical size of the Augmented Image when creating the Augmented Images database.

chilton commented 5 years ago

Compare this to Vuforia's image tracking. Even out of focus, it NAILS the orientation and location: https://www.youtube.com/watch?v=1vDjm-BWaoo

Google should be able to pull this off with ease. Don't they have a ton of realtime image detection and tracking code from Google Glasses and the image search engine?

somoreingold commented 5 years ago

Is this related to: https://github.com/google-ar/arcore-android-sdk/issues/537

ChristophGeske commented 5 years ago

Just to let you know the current alternative to achieve moving marker tracking is using Vuforia Fusion which uses ARCore for positional tracking and Vuforia for marker tracking. The disadvantages are that it is not free, it doesn't work on the Galaxy S7 and access to the ARCore features is limited.

somoreingold commented 5 years ago

Is it strange that ARCore 1.7 and Sceneform 1.7 now do smooth/realtime augmented faces tracking, but still not smooth/reatime augmented image marker tracking?

vjleo commented 5 years ago

+1 on the feature request.

Size of image should be only a parameter to match the scale of the world/objects, not to improve detection...

ARKit 2.0 has it:

ARReferenceImage improvement (now tracked) Reference images work the same as before, but now instead of just recognizing images, ARKit allows you to track them: when you move the reference image, the Image Anchor associated with them moves with the image, so you can have content that is anchored on those moving images.

cvasquez-github commented 5 years ago

+1 on the feature request, please! we really need support for moving image targets! The only option right now is Vuforia...