search

Tobias-Fischer / rt_gene

RT-GENE: Real-Time Eye Gaze and Blink Estimation in Natural Environments
http://www.imperial.ac.uk/personal-robotics
Other
366 stars 68 forks source link

Labels in Readme.md in wrong order #10

Closed BlueWinters closed 4 years ago

BlueWinters commented 5 years ago

Abs: README.md errors? I noticed some description about labels in README_Dataset.md:

label_combined.txt

... seq_number, [head pose: down(pos) / up (neg), left(pos) / right(neg)], [gaze: up(pos) / down(neg), right(pos) / left(neg)], timestamp

I compare some images and its correponding labels, and I think that it should be this form: [head pose: left(pos) / right(neg), down(neg) / up (pos)], [gaze: right(pos) / left(neg), up(pos) / down(neg)]

Tobias-Fischer commented 5 years ago

Hi @BlueWinters, Thanks for reporting this! I can confirm that the current order is taken from an old version and needs updating. I will check the precise order soon and let you know. Left/right definitely comes before up/down, but I need to double-check that left is really positive in head pose and negative in the eye gaze.

sahilrider commented 4 years ago

Any updates on this? What's the correct order? [gaze: right(pos)/left(neg), up(pos)/down(neg)] ?

Tobias-Fischer commented 4 years ago

Hi, I did a quick visual check, and I think it should be: [head pose: right(pos) / left(neg), up (pos) / down(neg)], [gaze: right(pos) / left(neg), up(pos) / down(neg)] (note that head pose left/right is with respect to the subject's torso)

We plan to release a new version of the dataset in which we will label it in a less confusing way ..

I'll update the readme for the next release.

/cc @ngageorange

sahilrider commented 4 years ago

Thanks for quick response. Head pose is ref wrt subject's torso, then what is the ref point for gaze. Now at the time of inference, gaze incorporates headpose or not as I can see headpose info is passed in the network. My Question is if I am looking at a point, then I get some reading for gaze and if I change my headpose little, will gaze value changes?

Hope my question is clear.

Tobias-Fischer commented 4 years ago

Hi - it should be called eye gaze - so ref is the midpoint between the eyes. So if you change your head pose, your gaze values should not change if you don't move your eyes.

sahilrider commented 4 years ago

Thanks for the clarification.

Tobias-Fischer commented 4 years ago

This has now been updated on both mirrors (box and zenodo). Thanks @BlueWinters for reporting.