Take into account the height of the webcam

ScottLogic / lookingatyou

Looking At You is a front-end application which uses computer vision to enable a pair of eyes to follow people using a webcam. The application was developed as part of the 2019 Scott Logic Internship Program.

http://scottlogic.github.io/lookingatyou

MIT License

0 stars 3 forks source link

Take into account the height of the webcam #31

Closed JeromeIllgner closed 5 years ago

JeromeIllgner commented 5 years ago

Add solution to adjust for webcam height so that eyes track at appropriate height.

Solution can be:

Adding option to config menu to adjust for height
Adding environment mapping to automatically determine measurements and position.
Use stereoscopic vision to enable environment mapping, related to (#29)

alecpgard commented 5 years ago

Needs some clarification if issue is due to positioning or size of the screen.

Adam-McDevitt commented 5 years ago

This issue won't be as simple as we first thought. Initially we thought we could simply add a "vertical offset" variable to the config menu, but a naive approach won't work as a different offset would be needed at different distances

Adam-McDevitt commented 5 years ago

We we partially able to solve the issue earlier by tilting the camera slightly - perhaps this will be enough? We should experiment properly at some point.

Adam-McDevitt commented 5 years ago

Could try and estimate distance of an object, from which we could extrapolate the required offset? Distance could maybe be estimated by looking at the difference of x value between the bounding boxes from either camera.

marcinscottlogic commented 5 years ago

There are number of models that can calculate the depth in a single image, however, they are mostly implemented in python using Tensorflow. This will not work with browser based application.

Example of such model: http://visual.cs.ucl.ac.uk/pubs/monoDepth/