usnistgov / frvt

Repository for the Face Recognition Vendor Test (FRVT)
Other
261 stars 114 forks source link

Does 1:1 Face test on images rotated to 90 or 180 degree? #107

Closed JackLin-Authme closed 1 year ago

JackLin-Authme commented 1 year ago

I saw 2 cases in common/faces folder, rotated_90.ppm and rotated_180.ppm.

Does it mean that there are some rotated image will be test in 1:1 protocol?

mlngan commented 1 year ago

We do not intend on testing with rotated images in our actual test. HOWEVER, these edge cases were put into the validation package to test that your algorithm does not crash in the event such unexpected cases are encountered.

mnktn commented 1 year ago

@mlngan and what about 1:N? Does it have rotated (90, 180) images in validation datasets?

mlngan commented 1 year ago

Yes. 1:1 and 1:N share a number of images in the validation set.

mnktn commented 1 year ago

Yes. 1:1 and 1:N share a number of images in the validation set.

Thanks. And what about the evaluation 1:N dataset? Should we expect rotated images there?

mlngan commented 1 year ago

We do not intend on testing with rotated images in the actual 1:N test.