pcr-upm / opal23_headpose

Headpose estimation using OPAL (2023)
MIT License
44 stars 4 forks source link

Testing the 300W-LP model using AFLW2000-3D data set #1

Closed bobetocalo closed 1 year ago

bobetocalo commented 1 year ago

-m test -p alignment -a /home/database/alignment/faces/landmarks/aflw2000/aflw2000_ann_original.txt --alignment opal23_headpose --database 300wlp --gpu 0 --rotation-mode euler --target-dist 1.6

MAE: 3.267257041061924
 > [yaw, pitch roll]: [2.77214107 4.25700197 2.77262808]
GE: 5.288789100801323
Confusion matrix:
[[  7   0   0   0   0   0   0   0   0   0   0   0   0]
 [  8  73  11   0   0   0   0   0   0   0   0   0   0]
 [  0  11  78   8   0   0   0   0   0   0   0   0   0]
 [  0   0  13  72  10   0   0   0   0   0   0   0   0]
 [  0   0   0   6 119  11   0   0   0   0   0   0   0]
 [  0   0   0   1  29 268  29   1   0   0   0   0   0]
 [  0   0   0   0   2  31 501  20   0   0   0   0   0]
 [  0   0   0   0   0   0  19 206  23   0   0   0   0]
 [  0   0   0   0   0   0   1   8 114  22   0   0   0]
 [  0   0   0   0   0   0   0   0   4  61  13   1   0]
 [  0   0   0   0   0   0   0   0   0   4  78  19   1]
 [  0   0   0   0   0   0   0   0   0   0   7  59  11]
 [  0   0   0   0   0   0   0   0   0   0   0   2   7]]
Accuracy (accurate class): 83.443%
Accuracy (adjacent class): 99.644%

Aligning the coordinates system of 300W-LP and AFLW2000-3D

MAE: 3.2583890566759286
[yaw, pitch roll]: [2.76167293 4.24114342 2.77235081]
GE: 5.277059978774396
Confusion matrix:
[[  7   0   0   0   0   0   0   0   0   0   0   0   0]
 [ 10  70  12   0   0   0   0   0   0   0   0   0   0]
 [  0  11  78   8   0   0   0   0   0   0   0   0   0]
 [  0   0  13  72  10   0   0   0   0   0   0   0   0]
 [  0   0   0   5 120  11   0   0   0   0   0   0   0]
 [  0   0   0   1  31 269  26   1   0   0   0   0   0]
 [  0   0   0   0   2  33 501  18   0   0   0   0   0]
 [  0   0   0   0   0   0  21 205  22   0   0   0   0]
 [  0   0   0   0   0   0   1   8 114  22   0   0   0]
 [  0   0   0   0   0   0   0   0   4  61  13   1   0]
 [  0   0   0   0   0   0   0   0   0   4  79  18   1]
 [  0   0   0   0   0   0   0   0   0   0   7  59  11]
 [  0   0   0   0   0   0   0   0   0   0   0   2   7]]
Accuracy (accurate class): 83.393%
Accuracy (adjacent class): 99.644%

-m test -p alignment -a /home/database/alignment/faces/landmarks/aflw2000/aflw2000_ann_original.txt --alignment opal23_headpose --database 300wlp --gpu 0 --rotation-mode 6d --target-dist 1.6

MAE: 3.50542770504606
 > [yaw, pitch roll]: [2.8585643  4.61332377 3.04439505]
GE: 5.368295973715439
Confusion matrix:
[[  7   0   0   0   0   0   0   0   0   0   0   0   0]
 [ 10  73   9   0   0   0   0   0   0   0   0   0   0]
 [  0  10  80   7   0   0   0   0   0   0   0   0   0]
 [  0   0  12  71  12   0   0   0   0   0   0   0   0]
 [  0   0   0   8 115  12   1   0   0   0   0   0   0]
 [  0   0   0   2  26 273  27   0   0   0   0   0   0]
 [  0   0   0   0   2  31 494  26   0   1   0   0   0]
 [  0   0   0   0   0   0  23 201  24   0   0   0   0]
 [  0   0   0   0   0   0   0   9 115  21   0   0   0]
 [  0   0   0   0   0   0   0   0   3  63  12   1   0]
 [  0   0   0   0   0   0   0   0   0   4  75  22   1]
 [  0   0   0   0   0   0   0   0   0   0   7  52  18]
 [  0   0   0   0   0   0   0   0   0   0   0   2   7]]
Accuracy (accurate class): 82.580%
Accuracy (adjacent class): 99.594%

Aligning the coordinates system of 300W-LP and AFLW2000-3D

MAE: 3.4857596196291447
[yaw, pitch roll]: [2.84092048 4.57667258 3.0396858 ]
GE: 5.34302057702222
Confusion matrix:
[[  7   0   0   0   0   0   0   0   0   0   0   0   0]
 [ 10  73   9   0   0   0   0   0   0   0   0   0   0]
 [  0  11  79   7   0   0   0   0   0   0   0   0   0]
 [  0   0  12  71  12   0   0   0   0   0   0   0   0]
 [  0   0   0   9 114  12   1   0   0   0   0   0   0]
 [  0   0   0   2  28 273  25   0   0   0   0   0   0]
 [  0   0   0   0   2  34 495  22   0   1   0   0   0]
 [  0   0   0   0   0   0  26 200  22   0   0   0   0]
 [  0   0   0   0   0   0   0  11 114  20   0   0   0]
 [  0   0   0   0   0   0   0   0   3  64  11   1   0]
 [  0   0   0   0   0   0   0   0   0   5  74  22   1]
 [  0   0   0   0   0   0   0   0   0   0   7  53  17]
 [  0   0   0   0   0   0   0   0   0   0   0   2   7]]
Accuracy (accurate class): 82.478%
Accuracy (adjacent class): 99.594%