search

samuelgoto / arpub

AR Content Publishing
9 stars 0 forks source link

Support for tracking 2d printed images #3

Open samuelgoto opened 6 years ago

samuelgoto commented 6 years ago

Both ARKit and ARCore have gained the ability to track 2d images in the real world based on an example and real world dimensions. Here are some notes I took here while reading these APIs.

https://developer.apple.com/documentation/arkit/recognizing_images_in_an_ar_experience

What should that look like as a landmark?

{
  @type: Artifact,
  asset: "vase.gltf",
  landmark: {
    @type: TrackedImage,
    url: "example.jpg",
    dimensions: {
      width: "30cm",
      height: "10cm",
      depth: "2cm"
    }
  }
}

Specifically, what are the properties of a tracked image? How are the dimensions used? What's the notation for units (css-like notation)? what should we call them?

skonig-google commented 6 years ago

Tracked images is a definite AR use case, but we'd need to think about how they would be used with Artifacts. Most tracked images are used in very constrained vertical solutions (e.g., in the context of a particular app or website), not as part of a horizontal AR Cloud or "world browser." If we imagine millions or hundreds of millions of tracked image Artifacts, it suddenly becomes really challenging to think about how that would work ... a user agent continually scanning the environment for matching images against a huge corpus would probably not scale.

On Tue, Aug 7, 2018 at 3:13 PM sam goto notifications@github.com wrote:

Both ARKit and ARCore have gained the ability to track 2d images in the real world based on an example and real world dimensions. Here are some notes I took here http://code.sgo.to/2018/06/28/exploring-image-tracking.html while reading these APIs.

https://developer.apple.com/documentation/arkit/recognizing_images_in_an_ar_experience

What should that look like as a landmark?

{ @type: Artifact, asset: "vase.gltf", landmark: { @type: TrackedImage, url: "example.jpg", dimensions: { width: "30cm", height: "10cm", depth: "2cm" } } }

Specifically, what are the properties of a tracked image? How are the dimensions used? What's the notation for units (css-like notation)? what should we call them?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/samuelgoto/arpub/issues/3, or mute the thread https://github.com/notifications/unsubscribe-auth/APftR75PWVMF7v6PxlK9GMpXICRnW7urks5uOebJgaJpZM4Vyuh5 .