search

lmb-freiburg / hand3d

Network estimating 3D Handpose from single color images
GNU General Public License v2.0
802 stars 252 forks source link

results on grey images? #19

Closed eyaler closed 5 years ago

eyaler commented 5 years ago

i tried to run on grey channel-averaged images and got nonsense results as compared to the color versions (my use case has only grey images). does this mean the model is fined tuned for caucasian hue, and won't work on grey images nor on people of color?

zimmerm commented 5 years ago

If you take away color the network loses one of the strongest cues it has learned to exploit, so it makes sense that it doesn't work on grey images. The bias regarding skin color is introduced by the dataset used for training, which dominantly features bright skin, but also other tones. For your use case I'd suggest to create a grayscale version of the dataset I used and retrain the network on that, although I'm not exactly sure on what performance to expect.