Use phone as controller

aframevr / a-painter

🎨 Paint in VR in your browser.

https://aframe.io/a-painter/

MIT License

680 stars 200 forks source link

Use phone as controller #158

Open FluorescentHallucinogen opened 8 years ago

FluorescentHallucinogen commented 8 years ago

Is it possible to use smartphone that has a gyroscope as controller?

Utopiah commented 8 years ago

Maybe using https://github.com/ryanbetts/dayframe but that would need a good rework of https://github.com/aframevr/a-painter/blob/master/src/components/paint-controls.js

FluorescentHallucinogen commented 7 years ago

Any progress?

FluorescentHallucinogen commented 7 years ago

Device Orientation (https://www.chromestatus.com/feature/5874690627207168)
Device Motion (https://www.chromestatus.com/feature/5556931766779904)

There also exist the newer APIs:

Motion Sensors APIs based on Generic Sensor API (https://www.chromestatus.com/feature/5698781827825664)

Utopiah commented 7 years ago

There probably won't be any progress except if you develop this since A-painter was done solely with roomscale and 6DoF controllers in mind.

Utopiah commented 7 years ago

Alternatively it would also be possible to use a Tango phone as a 6DoF controller, much easier to do now that https://github.com/googlevr/chromium-webar is public.

Chovin commented 5 years ago

I'd very much love to put work into this. Even if support for most phones isn't that great and we end up painting with the little sensors available on mobile browsers nowadays. Maybe we could use https://github.com/jeromeetienne/AR.js or maybe https://trackingjs.com/ as a frame of reference for the phone's position since it seems phone rotation might be the most supported piece of information we can pull from it.

If anyone wants to work on this, please let me know. I would be glad to offer some manpower. If nobody picks it up once I get some more time, I'd love to start on it myself.

Does anybody have any advice on where we could start looking to work on this?

Utopiah commented 5 years ago

@Chovin you might want to test A-painter XR first cf https://blog.mozvr.com/responsive-webxr-a-painter-xr/ because for iOS at least it seems to be doing roughly what you are suggesting.