search

ml4ai / tomcat

ToMCAT: Theory of Mind-based Cognitive Architecture for Teams
https://ml4ai.github.io/tomcat/
MIT License
21 stars 7 forks source link

Eye-tracker data validation #274

Open chinmaib opened 2 years ago

chinmaib commented 2 years ago

The eye-tracker data is susceptible to participants head motion. The software defines a bounding box around the screen, and also the captures pupil images. These measures might be affected if the participant adjusts or moves the camera. In LSL stream, we need to check if the confidence interval values are passed along. These measures are useful to determine validity of eye-tracker data.

val-pf commented 2 years ago

To add: We need to validate if we need the screen video the eyetracker is recording, or if having the screen recording from ffmpeg is enough.
Concerns: participants' head movements. Eyetracker screen camera vs eyes is the only "fixed distance" information we have and using just screen recordings from ffmpeg does not contain information of participants' location in relation to the screen.

CalebUAz commented 2 years ago

I was going through the eye data from the XDF file and this is what I observed:

Pilot from March 1st: Image

Pilot from April 22nd: Image

Dry run from July 12th: Image

As you can see Pilot from April 22nd and dry run from July 12th had no data coming in from pupil capture. Something has changed either in the Labrecorder or in pupil capture settings.

val-pf commented 2 years ago

Did you make sure the "stream to LSL' button was checked in the pupil recorder app (under settings)? It resets any time the software is updated or repaired. @chinmaib knows where to find this, too.

CalebUAz commented 2 years ago

I believe that is already checked @val-pf !

val-pf commented 2 years ago

Then I don't know ;-) settings in the app have been the cause of 95% of the issues we've had with pupil lab so far, so this was my best guess. The other 5% were physical issues, so plugs not being connected correctly in either one of the cameras or the whole tracker.

adarshp commented 2 years ago

Is there any way that we can set this 'stream to LSL' option in a config file rather than checking a button in a GUI?

CalebUAz commented 2 years ago

@adarshp if your talking about pupil capture GUI then that is needed to Multicast eye data into the LAN. If its Labworker your talking about then, we can ditch lab worker GUI (most likely) and come up with our version like how I developed the physio-viz-tool!