search

luxonis / depthai-experiments

Experimental projects we've done with DepthAI.
MIT License
835 stars 369 forks source link

gen2-gaze-estimation doesn't work as expected #312

Closed rexn8r closed 2 years ago

rexn8r commented 2 years ago

Hello,

I have downloaded gen2-gaze-estimation sample and tried on following environment;

DepthAI version : 2.15.0.0 OS : Tried on Windows 10 Home as well as Ubuntu 18.04

The gaze arrows always stays on the bottom right corner and doesn't move as expected (i.e the way it moves in the demo video posted on github along with the sample)

I rolled back depthai version from 2.15.0.0 to 2.7.2.0 and i got following error; ++++++++++++++++++++++++++++++++ Creating pipeline... Creating Color Camera... Creating Face Detection Neural Network... Creating Landmarks Detection Neural Network... Creating Head Pose Neural Network... Creating Gaze Estimation Neural Network... [2022-02-28 20:56:16.304] [warning] OpenVino version 2020.1 is deprecated and will be removed in the next release! [184430101152691200] [3903.858] [NeuralNetwork(10)] [warning] Network compiled for 8 shaves, maximum available 13, compiling for 6 shaves likely will yield in better performance [184430101152691200] [3903.859] [NeuralNetwork(4)] [warning] Network compiled for 7 shaves, maximum available 13, compiling for 6 shaves likely will yield in better performance [184430101152691200] [3903.859] [NeuralNetwork(2)] [warning] Network compiled for 7 shaves, maximum available 13, compiling for 6 shaves likely will yield in better performance [184430101152691200] [3903.902] [NeuralNetwork(7)] [warning] Network compiled for 4 shaves, maximum available 13, compiling for 6 shaves likely will yield in better performance [184430101152691200] [3903.916] [NeuralNetwork(10)] [Starting pipeline... warning] The issued warnings are orientative, based on optimal settings for a single network, if multiple networks are running in parallel the optimal settings may vary [184430101152691200] [3903.918] [system] [error] Attempted to start Color camera - NOT detected! [184430101152691200] [3903.916] [NeuralNetwork(4)] [warning] The issued warnings are orientative, based on optimal settings for a single network, if multiple networks are running in parallel the optimal settings may vary [184430101152691200] [3903.916] [NeuralNetwork(2)] [warning] The issued warnings are orientative, based on optimal settings for a single network, if multiple networks are running in parallel the optimal settings may vary [184430101152691200] [3903.916] [NeuralNetwork(7)] [warning] The issued warnings are orientative, based on optimal settings for a single network, if multiple networks are running in parallel the optimal settings may vary main.py:180: DeprecationWarning: Device(pipeline) starts the pipeline automatically. Use Device() and startPipeline(pipeline) otherwise self.device.startPipeline() ++++++++++++++++++++++++++++++++++++

If I include blobcoverter and change the setBlobPath to load the models, I am getting following error; ++++++++++++++++++++++++ face_nn.setBlobPath(blobconverter.from_zoo(name="face-detection-retail-0004", shaves=6)) IndexError: invalid map<K, T> key +++++++++++++++++++++++++++++

I would like to implement gaze along with other neural networks.

Any depthai expert out there who can throw a light as to how to resolve this?

thanks rex

Luxonis-Brandon commented 2 years ago

Sorry about the trouble. Asking.

Erol444 commented 2 years ago

Hello @rexn8r , could you try this PR, please? https://github.com/luxonis/depthai-experiments/pull/315