search

neurogears / vestibular-vr

Closed-loop VR setup for Rancz Lab
2 stars 0 forks source link

Online pupil position tacking (SLEAP) #25

Open RoboDoig opened 1 year ago

RoboDoig commented 1 year ago

NGR will provide resources and pointers on the training labeling phase.

We need to implement SLEAP tracking and logging in the current experiment workflow using a model trained by Ede's lab.

RoboDoig commented 9 months ago

To be able to train a useful SLEAP model, we need example pupil video data with some eye movements. To that end, need a workflow that generates a moving grating stimulus, e.g. sinusoidal movement of gratings in a virtual cylinder.

EleonoraAmbrad commented 8 months ago

videos for sleap training were sent via email (link to google drive). We are training the model on our end as well

RoboDoig commented 5 months ago

For implementation of online SLEAP tracking, setup instructions can be found here: https://bonsai-rx.org/sleap/

For exporting models: https://sleap.ai/guides/cli.html?highlight=export#sleap-export

Initial step would be to run a minimal workflow with SLEAP tracking on a prerecorded video to test the model. Next would be to add this to the main workflow with logging of tracked components.