hysts / pytorch_mpiigaze

An unofficial PyTorch implementation of MPIIGaze and MPIIFaceGaze
MIT License
346 stars 85 forks source link

infrared image implementation #60

Closed jasony93 closed 2 years ago

jasony93 commented 2 years ago

First of all, I appreciate for this great work. I went through the mpiifacegaze / mpiigaze datasets, but I decided that it is hard to add or customize data. I wanted to train with grayscale images (which will eventually become infrared images).

Is there a simple way to train with grayscale images?

Also, how can I add more data to existing dataset?

Or if you can tell me if ir image based implementation already exists.

Thank you!

hysts commented 2 years ago

Hi, @jasony93 As the images in the MPIIGaze dataset are grayscale, I think you can train a MPIIGaze model with this repo as is if you prepare your dataset in the same format as MPIIGaze dataset. And I don't think it's that hard to train a grayscale version of the MPIIFaceGaze model. It should work if you change the number of the first channel of the model to 1 and convert input images to grayscale.

jasony93 commented 2 years ago

Thank you I will take a look at it again!