search

RokidGlass / glass2-docs

Documentation for RokidGlass 2 Project
https://rokidglass.github.io/glass2-docs/
18 stars 4 forks source link

AR functionality on Rokid glasses #109

Open dalerr opened 3 years ago

dalerr commented 3 years ago

Hello! I searched for this information but found nothing.

My question: Can I create android AR projects for rokid glass same way as I develop using ARCore on android?

What I need: 1) plane recognition 2) Image/Marker recognition 3) ability to display 100.000 triangles at the same time.

What I expect: 1) Wearing glasses I recognize plane (floor) or image (waysign). 2) After this my 3D scene loads and shows 3D objects and interface. 3) User can interact with objects by voice or using touchpad controls on glasses. 4) User can walk and 3D objects are stays at place, where I first initialize AR scene.

Please help me understand, is it possible to create what i expect on rokid glasses?

shiwf commented 3 years ago

Sorry, our glass can not support AR functions like ARCore for now, but you can use Vuforia to do Image/Marker recognition, just like on android phone. Our GPU performance is a bit weak, if you display 100,000 triangles at the same time, the fps may be very low.

dalerr commented 3 years ago

Much obliged.

May be Rokid team have roadmap with things like new gen glass with ARCore support? Or may be this will be possible on current gen through connected android phone and streaming feed from glass camera?

shiwf commented 3 years ago

Much obliged.

May be Rokid team have roadmap with things like new gen glass with ARCore support? ---Our new gen glass will support Marker/plane recognition with our own algorithm, will not support ARCore. Or may be this will be possible on current gen through connected android phone and streaming feed from glass camera? ---Yes, it is possible, but you need to get glass camera data through UVC SDK and find the proper AR algorithm yourself. We do not support this solution for now.