search

TadasBaltrusaitis / OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
Other
6.93k stars 1.85k forks source link

problem about head pose estimation result #832

Open Angel113110 opened 4 years ago

Angel113110 commented 4 years ago

Dear author Recently, I tried to use openface to do head pose estimation. I met an problem which confuse me. That is some pictures result value in which the person's head is more partial than others is smaller than other pictures in which the head is straight. That's weird. Can you help me? Thanks!

TadasBaltrusaitis commented 4 years ago

Hi,

Can you post some images of the unexpected results you get? You have to keep in mind that there will be errors, as the estimation is approximate.

Angel113110 commented 4 years ago

For example, I attach two pictures for illustrating. The picture 7's value is larger than the picture 11. But, you can find that the person in picture 7 is looking forward and 11 is looking side. The up one is picture 7 and the other is 11. 7 11

TadasBaltrusaitis commented 4 years ago

What command line arguments did you use when extracting head pose from the images? When I try them, they look fine: 72410859-81cbc200-37a4-11ea-9836-811a693cea06 72410857-809a9500-37a4-11ea-9785-d6a3519a2242

I'm using: FaceLandmarkImg -multi_view 1 -wild -fdir <location of images>

Angel113110 commented 4 years ago

Dear author I use FeatureExtraction -fdir -pose to obtain head pose results. I have tried the solution you offered, but, when a person look side it looks invalid. I offer an example as follows: test1_052

Angel113110 commented 4 years ago

test1_012 test1_015 test1_020

The pictures above seems wrong in -Pose_Rx value. Can you help to solve it?

TadasBaltrusaitis commented 4 years ago

Can you send the complete profile image without the detected landmarks? The bounding box looks quite wrong in that.

With regards to the three images with pitch variations (pose_Rx), two of them seem to be roughly correct while only one of them is obviously wrong (further OpenFace knows that one of them is wrong, as the confidence value assigned for that detection is really low) 73916066-a1fc2600-48f7-11ea-9e1b-0d8b8313ed16 73916067-a294bc80-48f7-11ea-957a-79b811d96513 73916064-a0326280-48f7-11ea-8be1-37e67df67289

johnbone25 commented 3 years ago

@Angel113110 from the openface output values (in the csv) how do you detect if the person is looking up, down, right or left? Thank you

johnbone25 commented 3 years ago

@Angel113110 @TadasBaltrusaitis so, i obtained this values (namely gaze_angle, pose_T and so on) but how can i use them to understand if looking right, left, down or up? What are the intervals to determine if person looks right, left, up or down?