Open morriscb opened 1 year ago
Eye tracking runs in 2 phases:
/allen/aibs/technology/waynew/eye/bin/eye_dlc_phase1.py
This uses a deep learning model to predict coordinates of parts of the eye. It predicts 12 points for the entire eye, pupil, and corneal reflection.
The config for the model is at /allen/aibs/technology/waynew/eye/universal_eye_tracking-peterl-2019-07-10/config.yaml
. Various important data for the model can be found at /allen/aibs/technology/waynew/eye/universal_eye_tracking-peterl-2019-07-10
including training data, model, etc.
EYE_TRACKING queue in LIMS
/allen/aibs/technology/waynew/eye/bin/eye_dlc_phase2.py
This takes the coordinates output from (1) and fits and ellipse. We only ship the ellipse meta in the nwb files. EYE_ELLIPSE_FITTING queue in LIMS
Here's an example eye tracking frame. For each frame, it predicts 12 points for eye, pupil and corneal reflection. The eye points are in green, pupil in red and corneal reflection in blue. It also includes the fitted ellipse center which is what we ship in the nwb file as a triangle for eye, pupil, and cr. (0, 0) is the top left.
Currently, the code we run for eyetracking sits in a directory onprem rather than a version controlled repo. This epic encapsulates work for: