search

Tobias-Fischer / rt_gene

RT-GENE: Real-Time Eye Gaze and Blink Estimation in Natural Environments
http://www.imperial.ac.uk/personal-robotics
Other
365 stars 68 forks source link

Improve computational speed for multi person estimation #34

Closed Tobias-Fischer closed 4 years ago

Tobias-Fischer commented 4 years ago

At the moment the frame rate drops considerably when more than 3 people or so are in the scene. Let's find out where the bottleneck is and improve the speed.

Tobias-Fischer commented 4 years ago

@ngageorange and I have been working on this - the https://github.com/Tobias-Fischer/rt_gene/tree/modularised branch uses https://github.com/cleardusk/3DDFA for landmark extraction which was the main bottleneck. The overall pipeline is much faster now.

There is still room for improvement by passing batches of images to the gaze estimator, rather than doing the inference one-by-one.

ahmed-alhindawi commented 4 years ago

batching can now be found in the modularised branch. Multiperson setup works nicely there too.